-- Logs begin at Wed 2022-05-25 16:24:54 UTC, end at Wed 2022-05-25 17:26:40 UTC. -- May 25 16:59:49.332983 dv-cinder-843309-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 16:59:49.340208 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 16:59:49.342231 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 16:59:49 2022] *** May 25 16:59:49.342231 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 16:59:49.342231 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 16:59:49.342231 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: nodename: dv-cinder-843309-1-iscsi May 25 16:59:49.342231 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: machine: x86_64 May 25 16:59:49.342231 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: clock source: unix May 25 16:59:49.342231 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: pcre jit disabled May 25 16:59:49.342231 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: detected number of CPU cores: 4 May 25 16:59:49.342802 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: current working directory: / May 25 16:59:49.342802 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: detected binary path: /usr/bin/uwsgi-core May 25 16:59:49.342802 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: your processes number limit is 47680 May 25 16:59:49.342802 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: your memory page size is 4096 bytes May 25 16:59:49.342802 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: detected max file descriptor number: 2048 May 25 16:59:49.342802 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: lock engine: pthread robust mutexes May 25 16:59:49.342802 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: thunder lock: enabled May 25 16:59:49.342802 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 16:59:49.342802 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 16:59:49.388529 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: Python main interpreter initialized at 0x55fd5e43e9c0 May 25 16:59:49.388529 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: python threads support enabled May 25 16:59:49.388529 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: your server socket listen backlog is limited to 100 connections May 25 16:59:49.388529 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: your mercy for graceful operations on workers is 90 seconds May 25 16:59:49.388944 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: mapped 403077 bytes (393 KB) for 2 cores May 25 16:59:49.389024 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: *** Operational MODE: preforking *** May 25 16:59:49.389277 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: *** uWSGI is running in multiple interpreter mode *** May 25 16:59:49.389277 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: spawned uWSGI master process (pid: 103259) May 25 16:59:49.389480 dv-cinder-843309-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 16:59:49.390140 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: spawned uWSGI worker 1 (pid: 103260, cores: 1) May 25 16:59:49.390397 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: spawned uWSGI worker 2 (pid: 103261, cores: 1) May 25 16:59:49.390550 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 16:59:50.555648 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 16:59:50.608768 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 16:59:51.289986 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:59:51.289986 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: from cryptography.utils import int_from_bytes May 25 16:59:51.290502 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:59:51.290502 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: from cryptography.utils import int_from_bytes May 25 16:59:51.419022 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:59:51.419022 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: from cryptography.utils import int_from_bytes May 25 16:59:51.419341 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:59:51.419341 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: from cryptography.utils import int_from_bytes May 25 16:59:53.904754 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:59:53.905311 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:59:53.905537 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:59:53.905909 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:59:53.906168 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:59:53.906559 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.906887 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.907210 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.907530 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.907863 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.908175 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.908498 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.909407 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.909736 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.910000 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.910319 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.910647 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-1-iscsi {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.910971 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.911281 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.911595 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.911915 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.912223 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.912548 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.912883 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.913380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.913828 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.914132 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.914444 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.914795 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.915100 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.915414 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.915736 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.916051 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.916377 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.916696 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.917152 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-1-iscsi {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.917479 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.917797 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.918115 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.918532 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.918845 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.919157 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.919482 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.919803 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.920111 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.920438 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.920781 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.921102 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.921423 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.921726 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.922038 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.922347 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.922668 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.922975 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.923281 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.923533 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.923843 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.924167 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.924560 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.924985 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.925252 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.925505 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.925829 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.926150 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.926460 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.926776 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.927085 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.927394 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.927693 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.927999 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.928085 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:59:53.928466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.928549 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:59:53.928628 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.928840 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:59:53.928944 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.929201 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:59:53.929296 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.929455 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:59:53.929594 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.929852 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.929957 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.930155 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.930252 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.930474 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.930567 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.930791 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.930886 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.931103 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.931200 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.931419 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.931516 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.931738 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.931839 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.932043 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.932130 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.932361 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.932447 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.932618 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.932736 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.932963 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.933067 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.933286 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-1-iscsi {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.933379 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.933843 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.933936 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.934156 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.934246 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.934468 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.934556 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.934772 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.934857 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.935025 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.935157 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.935330 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.935418 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.935637 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.935732 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.935961 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.936161 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.936261 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.936469 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.936563 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.936797 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.936889 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.937109 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.937196 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.937443 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.937556 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.937758 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.937853 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.938064 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.938151 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.938370 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.938466 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.938678 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.938763 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.938980 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.939064 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.939289 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.939384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.939595 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.939738 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-1-iscsi {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.940474 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.941064 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.941064 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.941230 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.941311 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.941417 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.941550 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.941652 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.941844 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.941931 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.942152 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.942247 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.942461 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.942565 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.942783 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.942869 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.943090 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.943176 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.943396 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.943499 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.943717 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.943804 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.944025 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.944110 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.944331 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.944422 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.944643 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.944751 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.944973 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.945075 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.945277 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.945366 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.945593 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.945695 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.945894 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.945981 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.946194 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.946286 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.946445 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.946531 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.946752 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.946840 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.947072 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.947159 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.947389 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.947477 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.947693 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.947789 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.947942 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.948035 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.948190 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.948277 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.948507 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.948602 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.948848 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.948938 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.949157 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.949256 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.949463 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.949560 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.949768 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.949855 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.950071 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.950157 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.950375 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.950470 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.950676 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.950761 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.950979 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.951068 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.951282 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.951377 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.951595 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.951691 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.951904 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.951991 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.952221 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.952309 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.952524 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.952617 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.952864 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.952964 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.953227 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.953314 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.953493 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.953578 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.953799 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.953893 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.954134 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.954222 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.954448 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.954534 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.954754 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.954853 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.955065 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.955152 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.955379 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.955464 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.956349 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.956740 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.956740 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.956888 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.956967 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.957058 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.957225 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.957363 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.957546 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.957685 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.957848 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.958001 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.958101 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.958322 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.958418 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.958652 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.958746 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.958975 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.959070 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.959284 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.959381 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.959590 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.959677 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.959895 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.959989 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.960194 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.960289 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.960500 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.960587 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.960828 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.960918 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.961134 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.961220 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.961441 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.961528 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.961747 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.961835 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.962048 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.962136 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.962354 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.962440 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.962658 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.962746 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.962960 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.963046 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.963274 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.963371 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.963594 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.963683 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.963899 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.963985 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.964203 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.964297 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.964507 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.964595 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.964863 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.964963 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.965179 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.965265 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.965495 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.965594 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.965799 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.965887 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.966112 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.966208 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.966414 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.966499 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.966717 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.966803 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.967026 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.967121 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.967327 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.967433 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.967629 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.967718 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.967935 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.968021 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.968231 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.968317 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.968536 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.968628 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.968870 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.968971 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.969176 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.969263 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.969484 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.969570 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.969785 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.969882 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.970086 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.970177 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.970386 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.970480 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.970686 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.970782 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.970987 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.971073 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.971596 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.971702 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.971833 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.971933 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.972015 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.972238 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.972327 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.972563 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.972663 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.972896 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.972984 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.973203 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.973292 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.973508 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.973607 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.973816 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.973910 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:59:53.974120 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.974207 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.974433 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.974528 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.974743 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.974832 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.975052 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.975139 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.975363 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.975459 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.975675 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.975765 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.975999 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.976086 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.976317 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.976412 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.976629 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.976734 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.976986 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.977083 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.977295 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.977419 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.977602 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.977690 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.977911 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.977998 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.978228 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.978317 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.978543 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.978628 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.978851 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.978946 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.979163 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.979250 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.979468 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.979555 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.979773 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.979869 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.980078 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.980164 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.980388 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.980481 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.980727 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.980833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.981021 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.981108 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.981326 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.981417 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.981631 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.981727 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.981936 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.982022 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.982258 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.982344 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.982568 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.982656 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.982871 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.982965 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.983176 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.983272 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.983483 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.983572 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.983787 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.983882 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.984109 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.984197 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.984436 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.984525 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.984769 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.984876 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.985088 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.985180 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.985400 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.985496 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.985711 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.985807 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.986019 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.986118 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.986331 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.986429 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.986642 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.986742 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.987223 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.987338 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.987452 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.987723 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.987819 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.988039 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.988210 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.988363 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.988712 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.988804 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.989030 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.989130 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.989347 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.989444 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.989670 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.989757 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.989979 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.990066 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.990297 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.990402 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.990621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.990708 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.990956 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.991066 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.991275 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.991364 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.991597 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.991693 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.991911 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.992049 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.992229 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.992318 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.992539 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.992637 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.992877 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.992966 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.993190 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.993279 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.993499 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.993585 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.993810 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.993903 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.994120 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.994207 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.994422 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.994517 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.994733 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.994834 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.995044 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.995134 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.995348 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.995442 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.995664 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.995800 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.995970 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.996065 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.996273 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.996359 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.996595 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.996819 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.996916 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.997023 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.997220 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.997337 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.997533 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.997652 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.997843 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.997976 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.998155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.998288 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.998465 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.998600 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.998776 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.998914 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.999097 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.999220 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.999417 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.999528 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.999727 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:53.999838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.000060 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.000147 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.000390 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.000479 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.000710 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.000801 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.001037 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.001124 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.001361 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.001458 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.001670 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.001800 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.001970 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.002067 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.002274 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.003038 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.003560 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.003644 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.003732 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.003824 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.003951 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.004039 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.004112 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.004190 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.004315 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.004420 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.004619 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.004723 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.004959 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.005092 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.005263 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.005370 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.005566 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.005726 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.005879 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.005968 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.006188 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.006285 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.006490 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.006577 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.006794 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.006882 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.007098 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.007240 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.007428 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.007516 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.007730 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.007815 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.008057 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.008144 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.008369 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.008463 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.008698 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.008789 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.009017 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.009106 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.009327 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.009421 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.009643 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.009732 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.009956 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.010043 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.010265 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.010350 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.010576 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.010680 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.010884 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.010971 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.011194 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.011288 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.011502 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.011598 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.011822 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.011914 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.012131 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.012257 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.012441 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.012537 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.012774 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.012865 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.013080 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.013166 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.013385 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.013489 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.013700 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.013788 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.014040 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.014277 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.014377 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.014614 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.014702 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.014934 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.015022 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.015258 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.015361 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.015579 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.015675 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.015887 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.015974 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.016198 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.016295 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.016508 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.016602 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.016840 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.016929 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.017162 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.017296 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.017473 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.017561 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.017788 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.017877 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.018787 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.019173 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.019279 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.019361 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.019361 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.019521 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.019657 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.019767 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.019969 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.020079 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.020286 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.020394 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.020597 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.020747 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.020930 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.021064 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.021238 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.021373 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.021547 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.021686 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.021866 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.022006 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.022174 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.022316 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.022488 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.022628 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.022795 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.022939 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.023122 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.023245 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.023436 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.023532 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.023742 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.023830 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.024049 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.024135 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.024356 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.024447 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.024716 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.024818 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.025028 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.025118 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.025353 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.025449 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.025660 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.025756 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.025964 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.026051 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.026264 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.026352 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.026572 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.026658 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.026890 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.026978 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.027201 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.027288 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.027509 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.027604 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.027814 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.027910 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.028117 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.028203 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.028419 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.028505 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.028744 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.028846 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.029057 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.029142 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.029361 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.029455 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.029665 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.029765 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.029973 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.030068 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.030274 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.030359 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.030584 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.030684 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.030889 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.030977 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.031201 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.031287 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.031509 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.031596 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.031813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.031908 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.032117 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.032205 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.032422 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.032509 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.032752 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.032854 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.033057 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.033144 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.033367 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.033456 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.033747 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.034187 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.034273 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.034352 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.034444 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.034525 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.034603 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.034706 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.034890 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.035016 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.035200 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.035336 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.035508 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.035644 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.035812 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.035953 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.036135 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.036261 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.036453 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.036563 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.036785 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.036889 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.037092 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.037180 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.037401 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.037705 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.037794 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.038011 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.038109 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.038320 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.038408 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.038641 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.038747 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.038958 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.039054 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.039262 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.039349 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.039571 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.039671 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.039874 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.039962 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.040178 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.040264 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.040483 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.040584 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.040816 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.040914 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.041119 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.041208 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.041423 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.041510 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.041725 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.041814 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.042027 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.042124 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.042330 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.042417 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.042633 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.042728 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.042945 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.043034 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.043248 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.043344 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.043551 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.043637 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.043852 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.043938 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.044156 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.044255 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.044472 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.044566 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.044799 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.044902 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.045113 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.045210 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.045418 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.045513 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.045738 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.045826 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.046046 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.046146 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.046353 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.046448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.046657 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.046744 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.046961 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.047058 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.047275 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.047369 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.047587 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.047675 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.047901 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.047997 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.048205 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.048293 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.048510 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.048606 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.048854 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.048948 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.049164 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.049282 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.049742 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.049829 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.049829 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.049989 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.050146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.050263 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.050447 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.050615 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.050755 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.050884 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.051062 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.051195 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.051365 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.051510 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.051674 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.051821 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.051981 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.052131 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.052288 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.052441 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.052594 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.052776 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.052921 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.053088 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.053229 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.053399 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.053532 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.053713 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.053843 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.054025 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.054151 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.054335 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.054453 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.054646 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.054754 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.054955 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.055052 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.055260 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.055347 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.055585 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.055671 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.055898 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.055993 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.056203 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.056290 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.056519 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.056605 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.056844 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.056951 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.057148 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.057237 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.057451 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.057537 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.057758 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.057882 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.058066 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.058199 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.058366 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.058767 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.058940 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.059077 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.059248 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.059389 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.059552 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.059702 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.059854 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.060020 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.060165 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.060339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.060466 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.060645 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.060795 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.061086 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.061175 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.061398 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.061484 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.061710 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.061806 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.062013 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.062099 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.062316 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.062403 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.062617 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.062703 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.062922 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.063017 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.063222 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.063309 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.063527 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.063616 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.063828 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.063915 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.064127 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.064220 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.064431 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.064520 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.064755 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.065376 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.065608 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.066046 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.066149 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.066232 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.066310 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.066501 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.066589 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.066806 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.066894 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.067106 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.067230 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.067445 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.067539 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.067746 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.067835 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.068098 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.068193 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.068402 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.068497 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.068734 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.068824 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.069052 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.069151 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.069361 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.069448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.069667 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.069755 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.069976 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.070062 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.070276 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.070375 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.070594 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.070682 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.070902 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.070988 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.071211 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.071314 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.071509 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.071596 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.071810 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.071898 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.072127 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.072226 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.072433 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.072520 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.072769 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.072871 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.073091 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.073188 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.073411 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.073500 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.073730 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.073817 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.074032 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.074131 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.074337 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.074424 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.074646 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.074735 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.074954 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.075042 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.075259 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.075359 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.075564 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.075652 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.075872 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.075964 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.076176 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.076261 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.076481 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.076566 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.076812 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.076903 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.077122 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.077209 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.077423 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.077527 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.077727 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.077815 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.078031 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.078119 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.078333 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.078433 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.078653 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.078739 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.078956 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.079041 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.079258 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.079359 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.079565 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.079659 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.079867 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.079975 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.080174 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.080263 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.080526 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.080723 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.081182 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.081271 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.081355 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.081442 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.081530 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.081669 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.081854 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.081972 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.082162 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.082280 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.082487 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.082583 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.082819 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.082907 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.083149 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.083240 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.083463 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.083552 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.083797 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.083885 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.084125 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.084215 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.084442 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.084531 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.084814 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.084950 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.085083 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.085174 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.085383 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.085472 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.085691 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.085778 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.086002 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.086106 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.086301 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.086388 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.086603 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.086689 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.086903 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.086998 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.087217 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.087304 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.087513 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.087605 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.087812 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.087907 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.088116 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.088227 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.088436 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.088523 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.088767 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.088870 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.089095 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.089246 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.089406 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.089554 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.089712 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.089862 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.090017 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.090182 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.090322 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.090503 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.090666 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.090829 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.090972 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.091132 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.091307 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.091443 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.091626 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.091748 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.091949 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.092149 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.092277 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.092481 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.092578 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.092816 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.092928 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.093131 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.093247 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.093435 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.093564 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.093756 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.093879 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.094075 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.094194 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.094389 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.094508 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.094708 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.094808 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.095120 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.095210 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.095427 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.095523 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.095739 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.095825 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.096055 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.096884 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.096991 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.097139 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.097438 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.097585 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.097768 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.097899 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.098085 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.098212 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.098400 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.098519 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.098712 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.098878 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.099027 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.099137 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.099339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.099428 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.099651 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.099753 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.099963 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.100052 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.100274 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.100371 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.100583 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.100727 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.100936 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.101025 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.101258 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.101347 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.101562 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.101653 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.101885 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.101974 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.102199 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.102286 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.102516 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.102617 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.102833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.102919 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.103138 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.103271 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.103462 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.103551 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.103770 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.103858 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.104075 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.104181 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.104379 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.104468 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.104698 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.104792 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.105019 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.105120 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.105331 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.105419 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.105644 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.105733 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.105958 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.106055 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.106274 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.106371 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.106583 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.106678 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.106892 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.106981 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.107205 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.107302 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.107526 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.107613 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.107845 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.107933 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.108169 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.108257 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.108475 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.108563 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.108801 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.108893 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.109112 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.109201 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.109416 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.109517 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.109719 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.109940 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.110028 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.110256 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.110346 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.110586 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.110676 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.110894 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.110981 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.111200 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.111289 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.111517 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.111614 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.111943 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.112365 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.112451 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.112542 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.112633 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.112759 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.112844 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.113011 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.113141 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.113323 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.113453 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.113632 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.113759 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.113979 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.114069 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.114285 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.114375 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.114619 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.114708 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.114938 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.115026 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.115261 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.115350 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.115590 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.115797 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.115885 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.116146 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.116242 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.116463 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.116550 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.116812 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.116917 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.117140 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.117230 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.117453 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.117541 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.117762 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.117856 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.118074 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.118161 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.118382 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.118469 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.118688 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.118774 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.119000 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.119096 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.119311 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.119398 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.119615 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.119702 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.119921 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.120135 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.120224 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.120464 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.120551 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.120805 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.120897 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.121120 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.121208 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.121439 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.121528 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.121754 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.121853 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.122060 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.122154 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.122366 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.122454 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.122673 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.122761 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.122987 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.123129 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.123291 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.123455 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.123591 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.123783 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.123876 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.124105 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.124206 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.124431 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.124531 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.124795 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.124942 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.125106 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.125239 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.125411 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.125550 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.125721 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.125859 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.126027 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.126160 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.126342 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.126448 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.126683 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.126772 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.126989 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.127089 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.127303 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.127887 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.128120 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.128218 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.128441 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.128541 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.128774 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.128879 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.129101 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.129192 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.129413 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.129516 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.129726 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.129817 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.130047 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.130145 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.130358 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.130449 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.130669 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.130900 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.130990 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.131241 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.131346 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.131567 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.131657 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.131908 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.132005 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.132225 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.132323 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.132538 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.132628 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.132872 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.132969 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.133183 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.133388 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.133492 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.133706 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.133807 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.134034 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.134133 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.134357 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.134448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.134680 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.134770 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.134992 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.135091 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.135303 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.135392 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.135614 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.135703 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.135916 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.136011 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.136217 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.136321 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.136527 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.136634 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.136857 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.136949 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.137160 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.137249 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.137468 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.137556 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.137776 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.137884 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.138082 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.138180 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.138398 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.138501 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.138707 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.138817 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.139034 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.139235 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.139354 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.139582 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.139673 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.139897 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.139992 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.140222 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.140315 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.140549 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.140640 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.140893 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.140993 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.141204 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.141294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.141525 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.141621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.141834 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.141924 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.142137 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.142238 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.142451 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.142548 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.142760 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.142851 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.143148 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.143311 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.143454 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.143634 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.143853 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.143962 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.144166 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.144278 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.144470 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.144570 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.144804 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.144905 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.145107 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.145214 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.145436 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.145524 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.145741 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.145853 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.146046 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.146185 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.146351 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.146513 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.146666 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.146823 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.146969 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.147131 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.147273 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.147439 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.147579 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.147754 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.147881 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.148075 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.148175 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.148387 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.148475 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.148711 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.148861 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.149023 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.149112 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.149334 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.149422 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.149640 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.149729 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.149945 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.150034 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.150251 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.150339 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.150556 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.150647 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.150865 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.150954 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.151169 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.151257 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.151474 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.151571 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.151779 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.151868 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.152083 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.152174 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.152387 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.152483 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.152705 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.152795 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.153021 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.153128 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.153328 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.153418 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.153635 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.153887 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.153976 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.154227 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.154317 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.154529 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.154616 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.154863 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.154952 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.155200 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.155288 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.155511 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.155598 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.155820 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.155916 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.156129 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.156226 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.156451 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.156546 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.156785 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.156892 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.157098 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.157194 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.157409 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.157503 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.157718 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.157815 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.158027 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.158115 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.158337 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.158434 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.159272 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.159717 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.159806 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.159886 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.159886 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.160040 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.160170 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.160260 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.160478 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.160565 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.160813 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.160904 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.161125 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.161215 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.161440 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.161529 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.161780 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.161868 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.162100 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.162189 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.162421 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.162507 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.162736 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.162835 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.163054 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.163141 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.163363 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.163449 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.163672 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.163768 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.163982 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.164078 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.164290 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.164378 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.164605 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.164722 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.164943 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.165048 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.165256 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.165345 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.165563 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.165650 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.165881 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.165967 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.166211 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.166304 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.166539 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.166635 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.166852 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.166940 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.167180 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.167274 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.167499 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.167586 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.167822 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.167909 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.168133 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.168229 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.168454 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.168554 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.168786 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.168878 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.169118 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.169219 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.169434 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.169530 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.169740 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.169827 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.169986 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:59:54.170087 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.170372 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.170676 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.170980 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.171290 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.171608 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.171917 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.172229 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.172530 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.172868 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.173172 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.173476 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.173781 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.174084 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.174697 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.174832 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.175138 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.175443 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.175747 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.176051 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.176355 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.176661 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.176988 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.177293 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.177595 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.177901 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.178203 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.178534 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.178866 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.179180 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.179503 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.179859 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.180136 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.180445 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.180788 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.181112 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.181426 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.181735 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.182065 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.182380 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.182689 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.183000 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.183309 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.183881 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.184190 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.184516 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.184867 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.185176 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.185501 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.185818 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.186138 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.186452 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.186764 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.187094 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.187406 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.187715 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.188031 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.188340 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.188647 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.188984 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.189297 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.189623 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.190784 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.191034 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.191190 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.191517 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.191865 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.192182 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.192527 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.192952 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.193280 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.193592 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.193896 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:59:54.194140 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:59:54.228287 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO dbcounter [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Registered counter for database nova_api May 25 16:59:54.247974 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_db.sqlalchemy.engines [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:59:54.251665 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO dbcounter [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Registered counter for database nova_api May 25 16:59:54.255215 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writer thread running {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:59:54.272604 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG oslo_db.sqlalchemy.engines [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:59:54.278901 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writer thread running {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:59:54.315812 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.context [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a24b6412-6df0-4cb6-9852-3a2a26f5f191(cell1) {{(pid=103260) load_cells /opt/stack/nova/nova/context.py:464}} May 25 16:59:54.319945 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:59:54.321551 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:59:54.322342 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:59:54.324305 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:59:54.326282 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO dbcounter [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Registered counter for database nova_cell0 May 25 16:59:54.330236 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO dbcounter [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Registered counter for database nova_cell1 May 25 16:59:54.338636 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_db.sqlalchemy.engines [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:59:54.340802 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_db.sqlalchemy.engines [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:59:54.341575 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.context [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a24b6412-6df0-4cb6-9852-3a2a26f5f191(cell1) {{(pid=103261) load_cells /opt/stack/nova/nova/context.py:464}} May 25 16:59:54.345710 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG oslo_concurrency.lockutils [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:59:54.345843 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writer thread running {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:59:54.347536 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG oslo_concurrency.lockutils [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:59:54.348339 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG oslo_concurrency.lockutils [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:59:54.348431 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writer thread running {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:59:54.350301 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG oslo_concurrency.lockutils [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:59:54.352257 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO dbcounter [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Registered counter for database nova_cell0 May 25 16:59:54.356228 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO dbcounter [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Registered counter for database nova_cell1 May 25 16:59:54.364078 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG oslo_db.sqlalchemy.engines [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:59:54.367101 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG oslo_db.sqlalchemy.engines [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:59:54.369934 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writer thread running {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:59:54.492981 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO dbcounter [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Registered counter for database nova_cell0 May 25 16:59:54.501547 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_db.sqlalchemy.engines [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:59:54.506537 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writer thread running {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:59:54.509318 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writer thread running {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:59:54.517812 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO dbcounter [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Registered counter for database nova_cell0 May 25 16:59:54.524551 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG oslo_db.sqlalchemy.engines [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:59:54.529239 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writer thread running {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:59:54.844137 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: WARNING keystonemiddleware.auth_token [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:59:54.844334 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: WARNING keystonemiddleware.auth_token [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:59:54.852028 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: WARNING keystonemiddleware.auth_token [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:59:54.852174 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: WARNING keystonemiddleware.auth_token [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:59:55.193767 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: WARNING keystonemiddleware.auth_token [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:59:55.197757 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: WARNING keystonemiddleware.auth_token [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:59:55.199578 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: WARNING keystonemiddleware.auth_token [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:59:55.203728 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: WARNING keystonemiddleware.auth_token [None req-4603eb64-af24-4580-bc6f-1795c2112a91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:59:55.204876 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd5e43e9c0 pid: 103260 (default app) May 25 16:59:55.207081 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:59:55.208248 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] 10.222.0.31 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001832 May 25 16:59:55.208653 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 788 bytes} [Wed May 25 16:59:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:59:55.209324 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd5e43e9c0 pid: 103261 (default app) May 25 17:01:13.804502 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:13.805706 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 May 25 17:01:13.806353 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 2/2] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:13.823421 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_api:SELECT=3 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:13.824404 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_cell0:SELECT=3 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:13.825154 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_cell1:SELECT=3 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:13.826040 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_cell0:SELECT=3 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:14.280378 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-e678971c-dcf3-4223-8358-234636e3d80b admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:14.311225 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-e678971c-dcf3-4223-8358-234636e3d80b admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.496918 May 25 17:01:14.311963 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 1/3] 10.222.0.31 () {60 vars in 1291 bytes} [Wed May 25 17:01:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:01:16.629062 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:16.630071 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-ce846407-4503-40b2-9850-c4f27c838f2a None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 25 17:01:16.630481 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 3/4] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:16.695360 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f8018fa2-5653-4120-9ea6-6b482cffd00e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:16.714496 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:01:16.714496 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: warnings.warn(msg) May 25 17:01:16.743214 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f8018fa2-5653-4120-9ea6-6b482cffd00e admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106568 May 25 17:01:16.744725 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 2/5] 10.222.0.31 () {64 vars in 1282 bytes} [Wed May 25 17:01:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:01:16.758456 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_api:SELECT=3 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:16.759671 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_cell0:SELECT=3 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:16.761090 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_cell1:SELECT=3 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:16.762027 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:16.983900 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-21936ea7-86f1-4616-bd7b-a07dd6c8ed2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:16.987364 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:01:16.987364 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) May 25 17:01:17.052601 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-21936ea7-86f1-4616-bd7b-a07dd6c8ed2a admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.299408 May 25 17:01:17.053443 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 4/6] 10.222.0.31 () {64 vars in 1335 bytes} [Wed May 25 17:01:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:01:19.354264 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f8018fa2-5653-4120-9ea6-6b482cffd00e admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:19.355343 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f8018fa2-5653-4120-9ea6-6b482cffd00e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 May 25 17:01:19.355747 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 3/7] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:19.492103 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-d77dc488-8456-4a0e-92c4-a6c73a00aa8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:19.510586 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:01:19.510586 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) May 25 17:01:19.528884 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-d77dc488-8456-4a0e-92c4-a6c73a00aa8b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.166304 May 25 17:01:19.529427 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 5/8] 10.222.0.31 () {64 vars in 1282 bytes} [Wed May 25 17:01:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:01:19.541819 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-32e88e4e-3115-4183-9bf9-cc4c9162e06a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:19.543309 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:01:19.543309 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: warnings.warn(msg) May 25 17:01:19.575343 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-32e88e4e-3115-4183-9bf9-cc4c9162e06a admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037214 May 25 17:01:19.575903 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 4/9] 10.222.0.31 () {64 vars in 1335 bytes} [Wed May 25 17:01:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:01:21.851954 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-d77dc488-8456-4a0e-92c4-a6c73a00aa8b admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:21.853022 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-d77dc488-8456-4a0e-92c4-a6c73a00aa8b admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 25 17:01:21.853420 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 6/10] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:21.918451 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-11af7591-e6f9-473b-b1b9-6b1866c77889 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:21.939541 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-11af7591-e6f9-473b-b1b9-6b1866c77889 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079832 May 25 17:01:21.940332 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 5/11] 10.222.0.31 () {64 vars in 1282 bytes} [Wed May 25 17:01:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 17:01:21.952314 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-691d14d7-a6f8-4ee1-b686-24166e568fd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:21.976168 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-691d14d7-a6f8-4ee1-b686-24166e568fd8 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027589 May 25 17:01:21.977057 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 7/12] 10.222.0.31 () {64 vars in 1335 bytes} [Wed May 25 17:01:21 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:01:24.281349 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-11af7591-e6f9-473b-b1b9-6b1866c77889 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:24.283600 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-11af7591-e6f9-473b-b1b9-6b1866c77889 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 May 25 17:01:24.284029 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 6/13] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:24.354027 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-cef7f083-eee7-40ea-bcfe-90b4b3e43719 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:24.374142 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-cef7f083-eee7-40ea-bcfe-90b4b3e43719 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082788 May 25 17:01:24.374689 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 8/14] 10.222.0.31 () {64 vars in 1282 bytes} [Wed May 25 17:01:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:01:24.387852 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-bf1e2bf1-ca39-4705-ba82-43e67bf8c0d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:24.415246 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-bf1e2bf1-ca39-4705-ba82-43e67bf8c0d2 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031159 May 25 17:01:24.415848 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 7/15] 10.222.0.31 () {64 vars in 1335 bytes} [Wed May 25 17:01:24 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:01:26.728966 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-cef7f083-eee7-40ea-bcfe-90b4b3e43719 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:26.729964 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-cef7f083-eee7-40ea-bcfe-90b4b3e43719 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 25 17:01:26.730783 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 9/16] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:26.792553 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-649d51fa-71a0-4f9a-8610-a98209666de7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "vcpus": 4}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:26.813005 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-649d51fa-71a0-4f9a-8610-a98209666de7 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075965 May 25 17:01:26.814672 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 8/17] 10.222.0.31 () {64 vars in 1282 bytes} [Wed May 25 17:01:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:01:26.826445 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-0c13a5b3-252d-4293-bc51-bbfca3d7780c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:26.850494 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-0c13a5b3-252d-4293-bc51-bbfca3d7780c admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027851 May 25 17:01:26.851355 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 10/18] 10.222.0.31 () {64 vars in 1335 bytes} [Wed May 25 17:01:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:01:29.114475 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-649d51fa-71a0-4f9a-8610-a98209666de7 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:29.115479 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-649d51fa-71a0-4f9a-8610-a98209666de7 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 25 17:01:29.115871 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 9/19] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:29.174991 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-518cb25b-3bfb-455c-9884-272e75f0b1d9 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:29.198668 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-518cb25b-3bfb-455c-9884-272e75f0b1d9 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076707 May 25 17:01:29.203860 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 11/20] 10.222.0.31 () {60 vars in 1291 bytes} [Wed May 25 17:01:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:01:31.542295 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-649d51fa-71a0-4f9a-8610-a98209666de7 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:31.543307 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-649d51fa-71a0-4f9a-8610-a98209666de7 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 25 17:01:31.543705 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 10/21] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:31.614525 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-758b3e62-bbd3-428a-bc78-04fce2472f19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:31.633090 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-758b3e62-bbd3-428a-bc78-04fce2472f19 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083237 May 25 17:01:31.633664 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 12/22] 10.222.0.31 () {64 vars in 1282 bytes} [Wed May 25 17:01:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:01:31.646652 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-e88e8b90-ddf7-47db-9a0b-de1c705c1278 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:31.670463 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-e88e8b90-ddf7-47db-9a0b-de1c705c1278 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028742 May 25 17:01:31.671070 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 11/23] 10.222.0.31 () {64 vars in 1332 bytes} [Wed May 25 17:01:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:01:34.361685 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-758b3e62-bbd3-428a-bc78-04fce2472f19 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:34.362686 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-758b3e62-bbd3-428a-bc78-04fce2472f19 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 25 17:01:34.363086 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 13/24] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:34.437920 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-bf1a37aa-676c-4a96-af43-db751dd63172 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:34.462224 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-bf1a37aa-676c-4a96-af43-db751dd63172 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.093211 May 25 17:01:34.462720 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 12/25] 10.222.0.31 () {64 vars in 1282 bytes} [Wed May 25 17:01:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:01:34.475195 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-4fc5600f-163e-4978-b55e-b150aa9672ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:34.499798 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-4fc5600f-163e-4978-b55e-b150aa9672ac admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028181 May 25 17:01:34.500546 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 14/26] 10.222.0.31 () {64 vars in 1332 bytes} [Wed May 25 17:01:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:01:37.167330 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-bf1a37aa-676c-4a96-af43-db751dd63172 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:37.168488 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-bf1a37aa-676c-4a96-af43-db751dd63172 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 May 25 17:01:37.169325 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 13/27] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:37.229344 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-b328bbf0-6d7d-4bc6-9063-8abdf6354aff admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:37.247562 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-b328bbf0-6d7d-4bc6-9063-8abdf6354aff admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071756 May 25 17:01:37.248104 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 15/28] 10.222.0.31 () {64 vars in 1282 bytes} [Wed May 25 17:01:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:01:37.261177 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-a2adc7b7-7e60-4de6-a27f-586240ea1e34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:37.283625 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-a2adc7b7-7e60-4de6-a27f-586240ea1e34 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026266 May 25 17:01:37.284301 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 14/29] 10.222.0.31 () {64 vars in 1332 bytes} [Wed May 25 17:01:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:01:39.577020 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-b328bbf0-6d7d-4bc6-9063-8abdf6354aff admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:39.578064 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-b328bbf0-6d7d-4bc6-9063-8abdf6354aff admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 25 17:01:39.578460 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 16/30] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:39.637359 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-9538bc41-29e5-45a3-94ad-f66f9165b7a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:39.656960 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-9538bc41-29e5-45a3-94ad-f66f9165b7a7 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072442 May 25 17:01:39.657798 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 15/31] 10.222.0.31 () {64 vars in 1282 bytes} [Wed May 25 17:01:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 17:01:39.669495 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-542f37ce-4a4d-4701-b27f-20f38ecc4a4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:39.700222 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-542f37ce-4a4d-4701-b27f-20f38ecc4a4b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034399 May 25 17:01:39.702044 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 17/32] 10.222.0.31 () {64 vars in 1332 bytes} [Wed May 25 17:01:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:01:42.051865 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-9538bc41-29e5-45a3-94ad-f66f9165b7a7 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:01:42.052911 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-9538bc41-29e5-45a3-94ad-f66f9165b7a7 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 25 17:01:42.053503 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 16/33] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:01:42.117387 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-8b2d0b89-7a82-47f4-b6a3-0b1acff747e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:42.138546 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-8b2d0b89-7a82-47f4-b6a3-0b1acff747e2 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079216 May 25 17:01:42.139186 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 18/34] 10.222.0.31 () {64 vars in 1282 bytes} [Wed May 25 17:01:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:01:42.151739 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-bb80abcb-4eee-4430-b4bc-3029d116720d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:01:42.177609 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-bb80abcb-4eee-4430-b4bc-3029d116720d admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029455 May 25 17:01:42.178201 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 17/35] 10.222.0.31 () {64 vars in 1332 bytes} [Wed May 25 17:01:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:02:06.016517 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-8b2d0b89-7a82-47f4-b6a3-0b1acff747e2 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:06.017582 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-8b2d0b89-7a82-47f4-b6a3-0b1acff747e2 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 25 17:02:06.018091 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 19/36] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:02:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:02:06.029118 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:02:06.078813 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-71af9210-f7da-41c1-9f69-edffd5cb5543 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:06.095754 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-71af9210-f7da-41c1-9f69-edffd5cb5543 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071157 May 25 17:02:06.096298 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 18/37] 10.222.0.31 () {60 vars in 1291 bytes} [Wed May 25 17:02:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:02:07.083334 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-8b2d0b89-7a82-47f4-b6a3-0b1acff747e2 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:07.084332 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-8b2d0b89-7a82-47f4-b6a3-0b1acff747e2 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 25 17:02:07.084824 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 20/38] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:02:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:02:07.281837 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-bb6695d5-efb0-4b6b-b3ea-89f3b47c289e admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:07.287540 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.wsgi [None req-bb6695d5-efb0-4b6b-b3ea-89f3b47c289e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-bb6695d5-efb0-4b6b-b3ea-89f3b47c289e admin admin] Request method failure captured: May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Accept: application/json May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Accept-Encoding: gzip, deflate May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Connection: keep-alive May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Content-Length: 0 May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Host: 10.222.0.31 May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Openstack-Api-Version: compute 2.90 May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Openstack-System-Scope: None May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: User-Agent: python-novaclient May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Auth-Token: gAAAAABijmEPY97Ak7IMU23Ez3ejy9uEm5nVVYm-HkbXwvUE1cuZeglQ45SVOtwk24WqRmJKYsUJL6B9EuS9FD4H6hvax1a1Gkp2P9Zr-M3Ua1sG8e-vSDMDeXy2_fgnW9DGhKo2woJLHl7GSyqgsh6xzSwW0iq9KZY2rHo8Y6XjiYLGtds2AmU May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Domain-Id: None May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Domain-Name: None May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Identity-Status: Confirmed May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Is-Admin-Project: True May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Openstack-Nova-Api-Version: 2.90 May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Domain-Id: default May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Domain-Name: Default May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Name: admin May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Role: admin,reader,member May 25 17:02:07.290792 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Roles: admin,reader,member May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}] May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Tenant: admin May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Tenant-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Tenant-Name: admin May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User: admin May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Domain-Id: default May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Domain-Name: Default May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Id: cc4dc5eccddf4937ae7c342c241f1972 May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Name: admin May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: method: > May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: exception: Flavor 42 could not be found. May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: action_args: {'id': '42'} May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:02:07.292581 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:07.293621 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:07.294833 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-bb6695d5-efb0-4b6b-b3ea-89f3b47c289e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:02:07.295977 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-bb6695d5-efb0-4b6b-b3ea-89f3b47c289e admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062294 May 25 17:02:07.295977 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 19/39] 10.222.0.31 () {60 vars in 1190 bytes} [Wed May 25 17:02:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 25 17:02:07.302583 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-99713d3c-d0b1-4e58-8be3-daab8ac74557 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:07.305645 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:02:07.326707 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-99713d3c-d0b1-4e58-8be3-daab8ac74557 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028329 May 25 17:02:07.327261 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 21/40] 10.222.0.31 () {60 vars in 1210 bytes} [Wed May 25 17:02:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:02:07.340481 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-a168a004-568a-4e9e-b735-3af87790f079 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:07.361711 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-a168a004-568a-4e9e-b735-3af87790f079 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024867 May 25 17:02:07.362784 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 20/41] 10.222.0.31 () {60 vars in 1210 bytes} [Wed May 25 17:02:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:02:07.372667 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ea5f3b17-2a7e-430c-8034-5d63d9d5c553 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:07.379591 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.wsgi [None req-ea5f3b17-2a7e-430c-8034-5d63d9d5c553 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ea5f3b17-2a7e-430c-8034-5d63d9d5c553 admin admin] Request method failure captured: May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Accept: application/json May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Accept-Encoding: gzip, deflate May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Connection: keep-alive May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Content-Length: 0 May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Host: 10.222.0.31 May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Openstack-Api-Version: compute 2.90 May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Openstack-System-Scope: None May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: User-Agent: python-novaclient May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Auth-Token: gAAAAABijmEPY97Ak7IMU23Ez3ejy9uEm5nVVYm-HkbXwvUE1cuZeglQ45SVOtwk24WqRmJKYsUJL6B9EuS9FD4H6hvax1a1Gkp2P9Zr-M3Ua1sG8e-vSDMDeXy2_fgnW9DGhKo2woJLHl7GSyqgsh6xzSwW0iq9KZY2rHo8Y6XjiYLGtds2AmU May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Domain-Id: None May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Domain-Name: None May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Identity-Status: Confirmed May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Is-Admin-Project: True May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Openstack-Nova-Api-Version: 2.90 May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Id: default May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Name: Default May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Name: admin May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Role: admin,reader,member May 25 17:02:07.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Roles: admin,reader,member May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}] May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Tenant: admin May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Tenant-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Tenant-Name: admin May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User: admin May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Id: default May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Name: Default May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Id: cc4dc5eccddf4937ae7c342c241f1972 May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Name: admin May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: method: > May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: exception: Flavor 42 could not be found. May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: action_args: {'id': '42'} May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:02:07.384380 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:07.385339 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:07.386402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ea5f3b17-2a7e-430c-8034-5d63d9d5c553 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:02:07.387402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-ea5f3b17-2a7e-430c-8034-5d63d9d5c553 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015141 May 25 17:02:07.387402 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 22/42] 10.222.0.31 () {60 vars in 1190 bytes} [Wed May 25 17:02:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 17:02:08.245505 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-a168a004-568a-4e9e-b735-3af87790f079 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:08.246499 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-a168a004-568a-4e9e-b735-3af87790f079 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 25 17:02:08.246889 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 21/43] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:02:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:02:08.435617 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-428fc3a0-36f6-4924-8235-d9713ea5ba99 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:08.441421 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.wsgi [None req-428fc3a0-36f6-4924-8235-d9713ea5ba99 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-428fc3a0-36f6-4924-8235-d9713ea5ba99 admin admin] Request method failure captured: May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Accept: application/json May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Accept-Encoding: gzip, deflate May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Connection: keep-alive May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Content-Length: 0 May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Host: 10.222.0.31 May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Openstack-Api-Version: compute 2.90 May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Openstack-System-Scope: None May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: User-Agent: python-novaclient May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Auth-Token: gAAAAABijmEQQAmnJ2-CMG5eHBnMZ4DGEsKsnb-6VR1HxeNAnCFI0rsEBEssCywK7gFuNhJDY3SCuRzGCItI0ySEC4AU0TEFgUosUwLpe5d-_6VJZ1BLnIlDsA79W0P11FSuV83zm7FO0eNGi6BUNJHCRtxKI6Zv2LCalzzdz4H516iRGR16Qs8 May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Domain-Id: None May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Domain-Name: None May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Identity-Status: Confirmed May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Is-Admin-Project: True May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Openstack-Nova-Api-Version: 2.90 May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Id: default May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Name: Default May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Name: admin May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Role: admin,reader,member May 25 17:02:08.442917 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Roles: admin,reader,member May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}] May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Tenant: admin May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Tenant-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Tenant-Name: admin May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User: admin May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Id: default May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Name: Default May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Id: cc4dc5eccddf4937ae7c342c241f1972 May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Name: admin May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: method: > May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: exception: Flavor 84 could not be found. May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: action_args: {'id': '84'} May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:02:08.444466 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:08.445448 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:08.446850 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-428fc3a0-36f6-4924-8235-d9713ea5ba99 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:02:08.448127 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-428fc3a0-36f6-4924-8235-d9713ea5ba99 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060943 May 25 17:02:08.448127 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 23/44] 10.222.0.31 () {60 vars in 1190 bytes} [Wed May 25 17:02:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 17:02:08.453986 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-fefa4c0c-a32b-4e42-836d-e1d2218eedd8 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:08.467780 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-fefa4c0c-a32b-4e42-836d-e1d2218eedd8 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017277 May 25 17:02:08.468257 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 22/45] 10.222.0.31 () {60 vars in 1210 bytes} [Wed May 25 17:02:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:02:08.478120 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-68e15441-c2eb-4dab-899d-e0059001a5f5 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:08.492353 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-68e15441-c2eb-4dab-899d-e0059001a5f5 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017788 May 25 17:02:08.492893 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 24/46] 10.222.0.31 () {60 vars in 1210 bytes} [Wed May 25 17:02:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:02:08.501955 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f98ae9a4-6512-4ed4-9942-0e87ed184405 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:08.507751 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.wsgi [None req-f98ae9a4-6512-4ed4-9942-0e87ed184405 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f98ae9a4-6512-4ed4-9942-0e87ed184405 admin admin] Request method failure captured: May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Accept: application/json May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Accept-Encoding: gzip, deflate May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Connection: keep-alive May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Content-Length: 0 May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Host: 10.222.0.31 May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Openstack-Api-Version: compute 2.90 May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Openstack-System-Scope: None May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: User-Agent: python-novaclient May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Auth-Token: gAAAAABijmEQQAmnJ2-CMG5eHBnMZ4DGEsKsnb-6VR1HxeNAnCFI0rsEBEssCywK7gFuNhJDY3SCuRzGCItI0ySEC4AU0TEFgUosUwLpe5d-_6VJZ1BLnIlDsA79W0P11FSuV83zm7FO0eNGi6BUNJHCRtxKI6Zv2LCalzzdz4H516iRGR16Qs8 May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Domain-Id: None May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Domain-Name: None May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Identity-Status: Confirmed May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Is-Admin-Project: True May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Openstack-Nova-Api-Version: 2.90 May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Domain-Id: default May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Domain-Name: Default May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Name: admin May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Role: admin,reader,member May 25 17:02:08.509312 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Roles: admin,reader,member May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}] May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Tenant: admin May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Tenant-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Tenant-Name: admin May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User: admin May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Domain-Id: default May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Domain-Name: Default May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Id: cc4dc5eccddf4937ae7c342c241f1972 May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Name: admin May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: method: > May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: exception: Flavor 84 could not be found. May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: action_args: {'id': '84'} May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:02:08.510900 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:08.511898 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:08.513384 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f98ae9a4-6512-4ed4-9942-0e87ed184405 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:02:08.514691 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f98ae9a4-6512-4ed4-9942-0e87ed184405 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012337 May 25 17:02:08.514691 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 23/47] 10.222.0.31 () {60 vars in 1190 bytes} [Wed May 25 17:02:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 25 17:02:09.385857 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-68e15441-c2eb-4dab-899d-e0059001a5f5 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:09.386847 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-68e15441-c2eb-4dab-899d-e0059001a5f5 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 25 17:02:09.387232 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 25/48] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:02:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:02:09.574754 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-8ee7543b-09c6-4f40-9c41-c1d0903d29b4 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:09.582057 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.wsgi [None req-8ee7543b-09c6-4f40-9c41-c1d0903d29b4 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-8ee7543b-09c6-4f40-9c41-c1d0903d29b4 admin admin] Request method failure captured: May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Accept: application/json May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Accept-Encoding: gzip, deflate May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Connection: keep-alive May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Content-Length: 0 May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Host: 10.222.0.31 May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Openstack-Api-Version: compute 2.90 May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Openstack-System-Scope: None May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: User-Agent: python-novaclient May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Auth-Token: gAAAAABijmER4pro7TS5PaPluXWoiEe4WZWesM9gPSqzHebMZqLzh1ZTpRpGEvODq2Ia-H2Pky8JmzG_LHQL4r81VDsTkk0JivcAhLKuTw4BkJOYBAKf-3JP4x1DT9kE6lepSsagQlus98aLRfbhc5LOfqscdPByNMnBBY0Mvkkpy6bBnpi9Dds May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Domain-Id: None May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Domain-Name: None May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Identity-Status: Confirmed May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Is-Admin-Project: True May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Openstack-Nova-Api-Version: 2.90 May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Domain-Id: default May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Domain-Name: Default May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Project-Name: admin May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Role: admin,reader,member May 25 17:02:09.583547 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Roles: admin,reader,member May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}] May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Tenant: admin May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Tenant-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-Tenant-Name: admin May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User: admin May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Domain-Id: default May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Domain-Name: Default May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Id: cc4dc5eccddf4937ae7c342c241f1972 May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: X-User-Name: admin May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: method: > May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: exception: Flavor 451 could not be found. May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: action_args: {'id': '451'} May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:02:09.585155 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:09.586036 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 25 17:02:09.587146 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-8ee7543b-09c6-4f40-9c41-c1d0903d29b4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:02:09.588392 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-8ee7543b-09c6-4f40-9c41-c1d0903d29b4 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062473 May 25 17:02:09.588392 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 24/49] 10.222.0.31 () {60 vars in 1193 bytes} [Wed May 25 17:02:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 17:02:09.594611 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-4634bc7a-4775-470e-b868-9c8bf7bb4ba5 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:09.609551 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-4634bc7a-4775-470e-b868-9c8bf7bb4ba5 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018558 May 25 17:02:09.610066 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 26/50] 10.222.0.31 () {60 vars in 1210 bytes} [Wed May 25 17:02:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:02:09.620022 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:09.634164 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017633 May 25 17:02:09.634693 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 25/51] 10.222.0.31 () {60 vars in 1210 bytes} [Wed May 25 17:02:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:02:09.643802 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-89788247-6b2e-47ee-a114-a4b6f4d4a27d admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:09.649149 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.wsgi [None req-89788247-6b2e-47ee-a114-a4b6f4d4a27d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-89788247-6b2e-47ee-a114-a4b6f4d4a27d admin admin] Request method failure captured: May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Accept: application/json May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Accept-Encoding: gzip, deflate May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Connection: keep-alive May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Content-Length: 0 May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Host: 10.222.0.31 May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Openstack-Api-Version: compute 2.90 May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Openstack-System-Scope: None May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: User-Agent: python-novaclient May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Auth-Token: gAAAAABijmER4pro7TS5PaPluXWoiEe4WZWesM9gPSqzHebMZqLzh1ZTpRpGEvODq2Ia-H2Pky8JmzG_LHQL4r81VDsTkk0JivcAhLKuTw4BkJOYBAKf-3JP4x1DT9kE6lepSsagQlus98aLRfbhc5LOfqscdPByNMnBBY0Mvkkpy6bBnpi9Dds May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Domain-Id: None May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Domain-Name: None May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Identity-Status: Confirmed May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Is-Admin-Project: True May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Openstack-Nova-Api-Version: 2.90 May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Id: default May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Name: Default May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Project-Name: admin May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Role: admin,reader,member May 25 17:02:09.650619 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Roles: admin,reader,member May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/a1e51ce5f84b498ea59e7bf6bab45356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/a1e51ce5f84b498ea59e7bf6bab45356"}]}] May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Tenant: admin May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Tenant-Id: a1e51ce5f84b498ea59e7bf6bab45356 May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-Tenant-Name: admin May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User: admin May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Id: default May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Name: Default May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Id: cc4dc5eccddf4937ae7c342c241f1972 May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: X-User-Name: admin May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: method: > May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: exception: Flavor 451 could not be found. May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: action_args: {'id': '451'} May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:02:09.652294 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:09.653393 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi May 25 17:02:09.654813 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-89788247-6b2e-47ee-a114-a4b6f4d4a27d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:02:09.656088 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-89788247-6b2e-47ee-a114-a4b6f4d4a27d admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011814 May 25 17:02:09.656088 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 27/52] 10.222.0.31 () {60 vars in 1193 bytes} [Wed May 25 17:02:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 17:02:10.517802 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:10.519015 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 25 17:02:10.519352 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 26/53] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:02:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:02:10.713510 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-58586bcb-e86e-4ece-9cd1-6c616d21311f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:02:10.732173 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-58586bcb-e86e-4ece-9cd1-6c616d21311f admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071874 May 25 17:02:10.732634 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 28/54] 10.222.0.31 () {64 vars in 1235 bytes} [Wed May 25 17:02:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:02:11.656250 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:11.657557 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 25 17:02:11.657954 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 27/55] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:02:11.845094 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-2c3337d0-95ce-4d09-816a-5ff14b16f88b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:02:11.862092 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-2c3337d0-95ce-4d09-816a-5ff14b16f88b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068938 May 25 17:02:11.863360 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 29/56] 10.222.0.31 () {64 vars in 1235 bytes} [Wed May 25 17:02:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:02:12.736504 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:12.738305 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 25 17:02:12.738704 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 28/57] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:02:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:02:12.937147 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-33f33a72-a2db-4373-8a59-a92002f8d7fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:02:12.955216 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-33f33a72-a2db-4373-8a59-a92002f8d7fa admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.082003 May 25 17:02:12.955763 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 30/58] 10.222.0.31 () {64 vars in 1235 bytes} [Wed May 25 17:02:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:02:13.829654 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:13.830709 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 25 17:02:13.831144 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 29/59] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:02:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:02:14.021133 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-6bc4bfd4-9faf-48b4-aa1b-ad7defd9e605 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:02:14.038409 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-6bc4bfd4-9faf-48b4-aa1b-ad7defd9e605 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070299 May 25 17:02:14.038938 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 31/60] 10.222.0.31 () {64 vars in 1235 bytes} [Wed May 25 17:02:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:02:14.913942 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:14.915497 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001754 May 25 17:02:14.916097 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 30/61] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:02:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:02:15.111830 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-e6713d8b-38d6-40e9-8053-1b98fc0759ce admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:02:15.131863 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-e6713d8b-38d6-40e9-8053-1b98fc0759ce admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073482 May 25 17:02:15.132328 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 32/62] 10.222.0.31 () {60 vars in 1202 bytes} [Wed May 25 17:02:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:03:17.721606 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:03:17.722319 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-3eea9701-4b0f-4fcf-89ab-2ec4a0590d2c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 25 17:03:17.722722 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 31/63] 10.222.0.31 () {54 vars in 930 bytes} [Wed May 25 17:03:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:03:17.730355 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:03:17.782926 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-6da7d19c-dbbc-4bc2-b23f-269255dd5605 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:03:17.802460 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-6da7d19c-dbbc-4bc2-b23f-269255dd5605 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073687 May 25 17:03:17.802990 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 33/64] 10.222.0.31 () {60 vars in 1291 bytes} [Wed May 25 17:03:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:03:17.830413 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_api:SELECT=14 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:03:17.834375 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-8f9bd7bb-f7cb-473c-ae8e-50871435039a admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:03:17.841970 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-8f9bd7bb-f7cb-473c-ae8e-50871435039a admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013046 May 25 17:03:17.842499 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 32/65] 10.222.0.31 () {60 vars in 1282 bytes} [Wed May 25 17:03:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:03:17.854219 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-58ac7870-4647-4965-b7bb-8e8db0d63998 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:03:17.862404 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-58ac7870-4647-4965-b7bb-8e8db0d63998 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011286 May 25 17:03:17.862902 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 34/66] 10.222.0.31 () {60 vars in 1285 bytes} [Wed May 25 17:03:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:03:17.873701 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f667530e-5d03-4d03-a318-2e6461b22e01 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:03:17.881804 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f667530e-5d03-4d03-a318-2e6461b22e01 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011553 May 25 17:03:17.882324 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 33/67] 10.222.0.31 () {60 vars in 1285 bytes} [Wed May 25 17:03:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:03:17.894577 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-786aee1c-5840-4e70-8cc5-ca370ccc9234 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:03:17.902208 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-786aee1c-5840-4e70-8cc5-ca370ccc9234 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011193 May 25 17:03:17.902715 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 35/68] 10.222.0.31 () {60 vars in 1282 bytes} [Wed May 25 17:03:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:07:02.423424 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f667530e-5d03-4d03-a318-2e6461b22e01 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:07:02.424427 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f667530e-5d03-4d03-a318-2e6461b22e01 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 25 17:07:02.424852 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 34/69] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:07:02.589047 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_api:SELECT=6 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:07:02.706809 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-4a4ccac6-2005-4471-bca7-4c17cf81a276 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:07:02.708073 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:07:02.708073 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) May 25 17:07:02.709460 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-4a4ccac6-2005-4471-bca7-4c17cf81a276 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:07:02.709902 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-4a4ccac6-2005-4471-bca7-4c17cf81a276 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:07:02.710695 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-4a4ccac6-2005-4471-bca7-4c17cf81a276 admin admin] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:07:02.711131 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-4a4ccac6-2005-4471-bca7-4c17cf81a276 admin admin] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:07:02.745734 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-4a4ccac6-2005-4471-bca7-4c17cf81a276 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.161826 May 25 17:07:02.746282 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 36/70] 10.222.0.31 () {60 vars in 1193 bytes} [Wed May 25 17:07:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:07:03.629542 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f667530e-5d03-4d03-a318-2e6461b22e01 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:07:03.630675 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f667530e-5d03-4d03-a318-2e6461b22e01 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 May 25 17:07:03.631560 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 35/71] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:07:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:07:03.834664 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ae7aa96d-ed42-44fc-aa91-381863d0d74f admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:07:03.835844 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:07:03.835844 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) May 25 17:07:03.837064 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-ae7aa96d-ed42-44fc-aa91-381863d0d74f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:07:03.837512 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-ae7aa96d-ed42-44fc-aa91-381863d0d74f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:07:03.838351 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-ae7aa96d-ed42-44fc-aa91-381863d0d74f admin admin] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:07:03.838726 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-ae7aa96d-ed42-44fc-aa91-381863d0d74f admin admin] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:07:03.858117 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-ae7aa96d-ed42-44fc-aa91-381863d0d74f admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086303 May 25 17:07:03.858673 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 37/72] 10.222.0.31 () {60 vars in 1193 bytes} [Wed May 25 17:07:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:07:15.148738 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f667530e-5d03-4d03-a318-2e6461b22e01 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:07:15.149956 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f667530e-5d03-4d03-a318-2e6461b22e01 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 May 25 17:07:15.150355 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 36/73] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:07:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:07:15.295952 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_cell0:SELECT=4 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:07:15.296671 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_cell1:SELECT=4 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:07:15.297302 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_api:SELECT=8 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:07:15.348432 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-6ff8cf78-97c8-4ec8-9d03-17dc85bcb615 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:07:15.349985 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:07:15.349985 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) May 25 17:07:15.351191 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-6ff8cf78-97c8-4ec8-9d03-17dc85bcb615 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:07:15.351643 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-6ff8cf78-97c8-4ec8-9d03-17dc85bcb615 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:07:15.352442 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-6ff8cf78-97c8-4ec8-9d03-17dc85bcb615 admin admin] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:07:15.352902 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-6ff8cf78-97c8-4ec8-9d03-17dc85bcb615 admin admin] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:07:15.377629 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-6ff8cf78-97c8-4ec8-9d03-17dc85bcb615 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086169 May 25 17:07:15.378178 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 38/74] 10.222.0.31 () {60 vars in 1193 bytes} [Wed May 25 17:07:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:07:16.260624 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f667530e-5d03-4d03-a318-2e6461b22e01 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:07:16.261661 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f667530e-5d03-4d03-a318-2e6461b22e01 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 25 17:07:16.262085 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 37/75] 10.222.0.31 () {56 vars in 1074 bytes} [Wed May 25 17:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:07:16.458218 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-14075ed4-4b10-405f-b15f-f8247c467715 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:07:16.459478 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:07:16.459478 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) May 25 17:07:16.460719 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-14075ed4-4b10-405f-b15f-f8247c467715 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:07:16.461167 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-14075ed4-4b10-405f-b15f-f8247c467715 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:07:16.461942 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-14075ed4-4b10-405f-b15f-f8247c467715 admin admin] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:07:16.462367 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-14075ed4-4b10-405f-b15f-f8247c467715 admin admin] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:07:16.484123 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-14075ed4-4b10-405f-b15f-f8247c467715 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078319 May 25 17:07:16.484669 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 39/76] 10.222.0.31 () {60 vars in 1193 bytes} [Wed May 25 17:07:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:08:16.715211 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: Wed May 25 17:08:16 2022 - graceful shutdown triggered... May 25 17:08:16.715764 dv-cinder-843309-1-iscsi devstack@n-api.service[103261]: Gracefully killing worker 2 (pid: 103261)... May 25 17:08:16.715328 dv-cinder-843309-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 25 17:08:16.716867 dv-cinder-843309-1-iscsi devstack@n-api.service[103260]: Gracefully killing worker 1 (pid: 103260)... May 25 17:08:17.716324 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: worker 1 buried after 1 seconds May 25 17:08:17.716801 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: worker 2 buried after 1 seconds May 25 17:08:17.716801 dv-cinder-843309-1-iscsi devstack@n-api.service[103259]: goodbye to uWSGI. May 25 17:08:17.717970 dv-cinder-843309-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 25 17:08:17.718558 dv-cinder-843309-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 25 17:08:17.721294 dv-cinder-843309-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 17:08:17.736880 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 17:08:17 2022] *** May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: nodename: dv-cinder-843309-1-iscsi May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: machine: x86_64 May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: clock source: unix May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: pcre jit disabled May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: detected number of CPU cores: 4 May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: current working directory: / May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: detected binary path: /usr/bin/uwsgi-core May 25 17:08:17.751597 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: your processes number limit is 47680 May 25 17:08:17.752485 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: your memory page size is 4096 bytes May 25 17:08:17.752485 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: detected max file descriptor number: 2048 May 25 17:08:17.752485 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: lock engine: pthread robust mutexes May 25 17:08:17.752485 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: thunder lock: enabled May 25 17:08:17.752485 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 17:08:17.752485 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 17:08:17.803788 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: Python main interpreter initialized at 0x55a41ff679c0 May 25 17:08:17.803788 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: python threads support enabled May 25 17:08:17.803788 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: your server socket listen backlog is limited to 100 connections May 25 17:08:17.803788 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: your mercy for graceful operations on workers is 90 seconds May 25 17:08:17.804177 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: mapped 403077 bytes (393 KB) for 2 cores May 25 17:08:17.804256 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: *** Operational MODE: preforking *** May 25 17:08:17.804479 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: *** uWSGI is running in multiple interpreter mode *** May 25 17:08:17.804479 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: spawned uWSGI master process (pid: 117678) May 25 17:08:17.804700 dv-cinder-843309-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 17:08:17.805609 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: spawned uWSGI worker 1 (pid: 117695, cores: 1) May 25 17:08:17.805609 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: spawned uWSGI worker 2 (pid: 117696, cores: 1) May 25 17:08:17.805817 dv-cinder-843309-1-iscsi devstack@n-api.service[117678]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 17:08:19.017812 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 17:08:19.031592 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 17:08:19.828494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 17:08:19.828494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: from cryptography.utils import int_from_bytes May 25 17:08:19.828973 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 17:08:19.828973 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: from cryptography.utils import int_from_bytes May 25 17:08:19.847391 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 17:08:19.847391 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: from cryptography.utils import int_from_bytes May 25 17:08:19.847827 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 17:08:19.847827 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: from cryptography.utils import int_from_bytes May 25 17:08:22.297821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 17:08:22.298367 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 17:08:22.298617 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 17:08:22.299002 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 17:08:22.299280 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 17:08:22.299684 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.300042 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.300388 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.300736 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.301081 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.301404 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.301735 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.302606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.302945 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.303214 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.303630 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.304049 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-1-iscsi {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.304378 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.304732 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.305190 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.305398 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.305719 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.306055 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.306368 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.306878 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.307329 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.307646 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.307966 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.308313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.308634 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.308976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.309311 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.309641 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.309965 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.310285 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.310694 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-1-iscsi {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.311021 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.311342 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.311667 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.312110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.312413 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.312761 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.313093 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.313426 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.313740 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.314079 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.314655 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.314988 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.315316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.315628 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.315943 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.316260 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.316586 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.317103 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.317421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.317747 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.318694 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.319090 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.319477 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.319815 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.320076 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.320332 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.320665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.321020 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.321337 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.321653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.321970 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.322287 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.322601 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.322916 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.323228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.323540 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.323872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.324195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.324525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.324870 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.325203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.325613 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.325870 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.326205 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.326555 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.326884 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.327441 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.327773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.328105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.328425 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.328765 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.329086 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.329416 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.329757 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.330066 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.331358 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.331358 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.331358 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.331358 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.331672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.331851 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.332164 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.332474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.332815 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.333134 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.333578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.334014 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.334358 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.334665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.334983 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.335297 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.335616 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.335946 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.336280 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.336596 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.336934 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.337249 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.337567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.337893 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.338206 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.338519 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.338851 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.339169 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.339483 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.339811 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.340128 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.340443 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.340797 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.341108 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.341424 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.341752 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.342067 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.342380 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.342692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.343001 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.343313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.343624 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.343932 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.344241 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.344551 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.344901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.345237 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.345555 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.345869 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.346180 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.346509 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.346857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.347200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.347553 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.347878 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.348222 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.348562 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.349119 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.349464 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.349793 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.350133 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.350456 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.350778 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.351099 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.351428 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.351757 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.352100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.352426 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.352772 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.353105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.353442 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.354285 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.354285 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.354561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.354787 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.355115 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.355443 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.355769 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.356108 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.356442 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.356784 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.357107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.357429 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.357761 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.358105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.358429 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.358987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.359317 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.359642 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.359961 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.360284 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.360607 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.360986 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.361315 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.361641 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.361963 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.362287 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.362622 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.362929 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.363248 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.363564 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.363879 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.364193 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.364510 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.365364 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.365705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.366044 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.366362 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.366714 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.367027 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.367233 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 17:08:22.367716 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.367874 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 17:08:22.368028 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.368028 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.368332 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 17:08:22.368485 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.368658 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 17:08:22.368849 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.368997 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 17:08:22.369212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.369367 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.369534 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.369714 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.369871 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.370018 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.370172 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.370344 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.370501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.370652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.370804 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.370964 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.371117 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.371273 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.371419 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.371580 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.371757 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.371921 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.372067 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.372219 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.372651 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.372833 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.373013 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.373170 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-1-iscsi {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.373385 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.373555 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.373783 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.373944 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.374106 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.374271 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.374423 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.374576 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.374729 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.374881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.375041 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.375194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.375346 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.375492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.375636 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.375787 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.375975 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.376129 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.376275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.376426 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.376572 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.376572 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.376956 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.377105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.377259 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.377412 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.377569 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.377738 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.377884 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.378029 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.378185 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.378339 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.378485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.378637 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.378788 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.378940 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.379096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.379258 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.379412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-1-iscsi {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.379557 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.379722 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.379867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.380012 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.380214 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.381083 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.381373 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.381373 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.381729 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.381915 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.382076 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.382222 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.382376 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.382838 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.383157 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.383316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.383555 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.383555 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.383937 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.384094 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.384247 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.384406 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.384554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.384718 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.384889 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.384889 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.385185 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.385185 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.385470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.385623 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.385768 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.385913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.386072 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.386229 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.386385 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.386540 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.386693 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.386847 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.387105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.387277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.387432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.387585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.387740 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.387893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.388046 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.388201 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.388353 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.388508 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.388664 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.388902 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.389071 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.389231 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.389393 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.389548 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.389548 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.389832 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.389985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.390130 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.390282 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.390426 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.390570 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.390725 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.390894 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.391046 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.391191 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.391334 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.391487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.391639 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.391793 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.391938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.392090 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.392234 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.392377 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.392529 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.393004 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.393177 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.393333 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.393479 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.393706 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.393867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.394101 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.394260 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.394408 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.394560 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.394705 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.394863 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.395019 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.395172 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.395338 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.395492 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.395637 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.395803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.396032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.396256 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.396438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.396585 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.396762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.396915 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.397088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.397314 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.397483 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.397630 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.397859 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.398007 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.398007 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.398299 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.398451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.398451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.398929 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.399100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.399250 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.399403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.399549 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.399704 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.399858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.400010 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.400156 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.400309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.400454 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.400608 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.400827 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.400982 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.401128 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.401273 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.401425 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.401580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.401742 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.401895 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.402040 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.402184 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.402337 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.402491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.402643 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.402807 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.403265 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.403265 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.403562 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.403739 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.403951 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.404137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.404356 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.404508 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.404661 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.404845 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.404991 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.405144 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.405289 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.405441 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.405603 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.405749 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.405893 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.406037 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.406249 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.406400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.406560 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.406720 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.406865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.407024 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.407169 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.407331 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.407546 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.407704 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.407860 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.408014 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.408169 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.408325 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.408470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.408624 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.408816 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.408977 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.409133 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.409278 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.409429 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.409580 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.409734 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.409888 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.410042 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.410197 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.410350 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.410495 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.410647 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.410793 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.410944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.411098 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.411243 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.411386 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.411627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.411788 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.411935 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.412088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.412244 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.412391 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.412724 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.412898 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.413392 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.413545 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.413690 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.413836 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.413836 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.414216 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.414380 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.414607 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.414757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.414924 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.415071 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.415225 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.415225 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.415507 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.415652 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.415805 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.415957 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.416110 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 17:08:22.416262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.416407 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.416560 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.416749 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.416918 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.417067 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.417220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.417364 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.417526 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.417742 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.417900 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.418047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.418200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.418353 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.418506 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.418659 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.418814 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.418986 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.419149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.419304 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.419457 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.419601 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.419745 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.419903 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.420055 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.420201 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.420352 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.420352 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.420636 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.420898 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.421047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.421192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.421337 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.421481 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.421637 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.421795 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.421941 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.422093 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.422239 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.422394 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.422539 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.422703 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.422850 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.423001 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.423167 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.423624 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.423771 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.423925 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.424088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.424301 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.424459 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.424623 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.424872 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.425032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.425196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.425341 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.425504 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.425754 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.425935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.426083 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.426237 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.426383 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.426535 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.426680 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.426906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.427567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.427748 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.427982 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.428141 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.428301 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.428455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.428608 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.428786 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.428978 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.429133 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.429288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.429442 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.429596 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.429748 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.429892 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.430055 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.430209 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.430361 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.430507 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.430652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.430796 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.430940 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.431093 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.431239 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.431382 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.431526 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.431670 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.431670 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.431965 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.432109 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.432259 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.432403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.432547 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.432718 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.432887 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.433036 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.433180 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.433350 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.433798 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.433955 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.434113 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.434281 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.434496 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.434652 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.434798 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.435045 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.435197 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.435351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.435505 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.435657 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.435802 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.435960 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.435960 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.436256 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.436256 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.436536 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.436731 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.436894 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.437050 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.437195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.437339 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.437483 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.437635 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.437787 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.437958 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.438180 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.438348 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.438493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.438650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.438795 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.438939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.439084 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.439228 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.439620 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.439779 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.439924 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.440069 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.440221 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.440376 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.440529 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.440700 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.440862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.441008 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.441155 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.441299 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.441451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.441597 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.441741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.441886 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.442037 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.442037 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.442337 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.442482 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.442634 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.442849 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.443527 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.443999 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.444153 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.444314 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.444485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.444724 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.444896 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.445074 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.445315 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.445493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.445652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.445813 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.445973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.446138 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.446298 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.446451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.446602 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.446753 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.446904 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.447066 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.447226 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.447379 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.447548 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.447548 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.447877 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.448037 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.448212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.448212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.448589 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.448759 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.448759 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.449075 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.449228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.449379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.449531 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.449703 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.449864 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.450024 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.450184 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.450345 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.450497 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.450663 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.450827 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.450980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.451139 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.451290 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.451441 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.451618 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.451779 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.451939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.452092 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.452243 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.452393 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.452553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.452729 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.452898 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.453058 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.453210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.453361 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.453581 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.454081 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.454249 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.454402 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.454554 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.454733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.454968 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.455132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.455303 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.455533 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.455696 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.455859 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.456018 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.456178 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.456351 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.456513 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.456665 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.456857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.457010 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.457161 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.457320 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.457473 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.457625 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.457786 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.457947 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.458107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.459053 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.459239 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.459394 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.459558 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.459721 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.459881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.460044 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.460198 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.460198 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.460499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.460499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.460823 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.460978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.461141 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.461305 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.461459 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.461618 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.461778 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.461932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.462099 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.462317 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.462478 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.462647 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.462811 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.462971 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.463133 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.463305 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.463465 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.463627 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.463778 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.464255 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.464468 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.464636 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.464883 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.465133 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.465292 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.465445 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.465700 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.465868 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.466033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.466033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.466323 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.466474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.466639 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.466857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.467045 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.467201 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.467354 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.467505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.467670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.467824 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.467976 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.468148 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.468309 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.468470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.468641 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.468818 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.468971 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.469220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.469381 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.469550 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.469712 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.469712 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.470007 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.470177 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.470336 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.470566 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.470728 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.470881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.471039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.471191 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.471349 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.471511 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.471671 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.471822 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.471981 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.472140 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.472309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.472474 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.472653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.472955 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.473113 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.473265 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.473434 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.473595 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.473755 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.473932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.474405 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.474582 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.474752 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.474916 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.475068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.475318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.475484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.475638 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.475904 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.476070 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.476223 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.476375 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.476534 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.479226 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.479226 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.479696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.479880 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.480040 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.480203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.480368 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.480533 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.480737 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.480900 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.481066 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.481220 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.481381 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.481534 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.481692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.481865 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.482027 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.482180 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.482345 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.482512 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.482669 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.482831 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.482990 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.483145 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.483306 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.483465 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.483625 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.483784 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.483953 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.484121 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.484838 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.485017 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.485181 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.485364 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.485601 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.485601 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.486020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.486833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.487009 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.487223 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.487402 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.487580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.487735 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.487884 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.488008 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.488121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.488327 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.488494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.488648 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.488835 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.488988 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.489141 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.489141 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.489141 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.490206 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.490206 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.490531 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.490692 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.490962 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.491161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.491377 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.491563 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.491753 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.491912 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.492080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.492233 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.492397 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.492552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.492760 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.492940 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.493113 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.493280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.493440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.493608 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.493760 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.493913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.494066 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.494217 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.494393 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.494906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.495077 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.495231 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.495390 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.495550 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.495803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.495970 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.496234 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.496400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.496561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.496732 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.496909 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.497070 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.497240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.497393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.497545 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.497696 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.497857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.498018 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.498170 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.498329 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.498481 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.498631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.498797 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.499019 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.499197 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.499362 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.499515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.499515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.499815 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.499815 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.500117 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.500354 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.500521 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.500744 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.500905 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.500905 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.500905 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.501362 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.501515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.501684 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.501844 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.501997 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.502149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.502149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.502383 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.502474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.502474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.502630 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.502718 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.502802 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.502890 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.502988 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503081 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503326 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503411 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503484 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503556 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503633 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503713 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503785 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.503938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.504022 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.504096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.504174 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.504174 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.504312 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.504398 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.504472 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.504542 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.504621 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.505043 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.505135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.505311 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.505909 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506000 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506074 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506152 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506405 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506639 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506710 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506787 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506869 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.506942 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.507021 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.507101 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.507173 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.507251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.507337 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.507411 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.507482 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.507552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.507622 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.508440 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.508539 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.508615 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.508615 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.508813 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.508901 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.508995 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509087 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509170 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509245 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509325 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509472 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509543 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509613 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509692 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509778 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509852 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509924 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.509994 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.510065 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.510065 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.510065 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.510065 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.510334 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.510420 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.510493 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.510579 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.510652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.510723 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.511685 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.511790 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.511867 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.511949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512176 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512248 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512248 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512391 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512465 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512535 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512612 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512703 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512783 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512874 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.512874 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513007 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513086 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513159 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513239 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513312 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513383 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513461 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513534 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513613 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513699 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513699 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513836 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513915 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.513987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.514078 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.514165 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.514238 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.514316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.514397 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.514484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.514575 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.514655 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.514727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515137 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515228 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515449 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515449 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515586 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515586 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515715 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515796 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515877 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.515957 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.516037 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.516037 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.516174 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.516255 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.516483 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.516591 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.516667 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.516772 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.516857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.516940 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517013 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517165 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517244 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517244 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517386 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517465 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517545 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517624 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517704 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517704 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517924 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.517998 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518069 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518139 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518218 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518298 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518371 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518442 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518512 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518591 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518663 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518747 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518820 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518892 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.518963 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.519145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.519254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.519460 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.519544 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.519795 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.519927 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.520116 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.520250 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.520434 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.520567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.520881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.521052 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.521281 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.521424 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.521623 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.521849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.522125 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.522234 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.522448 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.522551 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.522762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.522847 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.523087 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.523179 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.523403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.523488 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.523719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.523808 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.524031 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.524122 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.524347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.524445 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.524671 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.524964 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.525374 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.525453 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.525539 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.525613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.525684 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.525977 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.526074 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.526165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.526262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.526337 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.526609 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.526707 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.526884 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.526980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.527223 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.527308 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.527544 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.527627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.527854 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.527949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.528212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.528294 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.528539 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.528632 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.529373 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.529545 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.529701 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.529862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.530022 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.530022 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.530330 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.530494 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.530646 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.530797 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.530955 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.531108 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.531268 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.531510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.531677 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.531831 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.531998 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.532152 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.532313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.532480 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.532631 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.532822 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.532976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.533128 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.533289 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.533442 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.533601 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.533754 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.533905 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.533905 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.534215 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.534386 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.534540 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.534691 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.534842 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.535002 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.535466 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.535637 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.536300 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.536500 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.536899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.537074 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.537275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.537466 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.537635 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.537795 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.537947 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.538112 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.538273 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.538439 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.538439 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.538745 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.538958 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.539117 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.539270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.539428 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.539599 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.539762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.539923 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.540076 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.540235 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.540387 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.540545 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.540724 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.540900 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.541053 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.541211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.541366 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.541534 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.541777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.541947 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.542101 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.542101 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.542389 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.542540 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.542704 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.542857 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.543008 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.543160 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.543320 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.543472 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.543643 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.543809 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.543972 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.544125 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.544275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.544426 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.544591 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.544778 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.544935 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.545094 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.545246 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.545710 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.545879 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.546053 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.546206 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.546366 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.546524 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.546689 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.546994 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.547166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.547319 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.547470 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.547622 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.547787 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.547940 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.548104 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.548264 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.548434 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.549984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.550166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.550324 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.550493 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.550656 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.550816 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.550984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.551145 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.551298 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.551450 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.551614 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.551786 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.552541 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.552790 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.552955 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.553107 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.553329 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.553511 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.553674 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.553826 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.553977 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.554128 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.554279 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.554457 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.554611 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.554770 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.554930 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.555081 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.555233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.555399 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.555877 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.556052 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.556209 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.556360 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.556521 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.556521 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.556894 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.557194 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.557353 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.557524 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.557524 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.557833 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.557833 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.558697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.558863 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.559024 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.559186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.559338 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.559505 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.559659 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.560396 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.560556 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.560731 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.560892 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.561065 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.561232 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.561385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.561543 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.561711 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.561876 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.562062 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.562294 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.562454 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.562614 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.562775 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.562929 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.563224 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.563394 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.563555 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.563715 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.563877 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.564040 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.564219 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.564658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.564884 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.565047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.565208 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.565360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.565526 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.566039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.566216 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.566371 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.566524 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.566689 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.566849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.566849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.567331 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.567499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.567685 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.568468 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.568712 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.568878 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.569032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.569183 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.569334 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.569499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.569499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.569807 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.569961 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.570114 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.570279 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.570432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.570583 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.570733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.570898 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.571050 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.571213 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.571365 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.571365 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.571652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.571814 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.571965 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.572130 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.572316 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.572518 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.572712 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.572882 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.573044 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.573230 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.573461 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.573618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.573777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.574181 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.574353 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.574507 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.574665 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.574825 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.574977 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575128 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575228 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575579 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575673 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575769 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 17:08:22.575873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.575873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.576811 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.576811 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.576811 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.576811 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.576811 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.576811 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.576811 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.576811 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.577541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.577541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.577541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.577541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.577541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.577541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.577541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.577541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.578125 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.578125 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.578125 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.578504 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.578831 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.579174 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.579509 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.579842 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.580169 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.580534 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.580873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.581189 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.581502 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.581819 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.582134 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.582444 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.582775 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.583091 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.583468 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.584044 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.584458 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.585045 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.585409 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.585737 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.586074 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.586414 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.586739 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.587056 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.587392 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.587709 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.588023 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.588348 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.588667 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.589004 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.589318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.589636 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.589953 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.590266 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.590599 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.590897 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.591229 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.591541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.591854 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.592166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.592484 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.592820 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.593135 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.593448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.593757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.594082 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.594391 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.594707 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.595023 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.595341 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.595651 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.595965 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.596324 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.596722 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.597076 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.597391 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.598399 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.598399 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.598399 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.598651 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.599755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.600355 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.600703 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.601266 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.601779 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.602260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.602614 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.602961 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.603278 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.603596 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.603915 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.604249 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.604571 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.605956 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.605956 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.605956 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.605956 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.606303 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.606469 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.606794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.607091 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.607409 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.607722 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.608038 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.608358 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.608700 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.609063 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.609388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.609712 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.610033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.610357 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.610677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.611149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.611472 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.611790 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.612112 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.612449 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.612798 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.613112 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.613548 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.613869 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.614195 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.614563 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.615613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.616060 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.616401 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.617081 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.617420 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.617746 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.618091 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.618442 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.618789 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.619127 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.619445 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.619760 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.620075 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.620393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.620745 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.621068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.621382 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.621696 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.622012 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.622325 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.622638 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.622948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.624432 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.624775 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.625102 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.625420 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.625738 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.626049 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.626365 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.626686 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.627008 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.627320 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.627634 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.627948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.628262 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.628573 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.628950 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.629296 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.629619 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.629951 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.630449 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.631038 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.631411 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.631745 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.632078 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.632406 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.632747 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.633093 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.633410 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.633732 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.634056 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.634376 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.634693 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.635010 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.635347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.635682 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.636000 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.636339 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.636670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.637070 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.637453 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.637627 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.637966 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.638278 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.638594 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.639064 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.639235 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.639555 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.639878 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.640200 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.640533 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.640896 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.641217 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.641550 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.641885 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.642092 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO dbcounter [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Registered counter for database nova_api May 25 17:08:22.642248 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.642556 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.642911 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.643249 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.643572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.643891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.644205 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 17:08:22.644455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 17:08:22.663857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_db.sqlalchemy.engines [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 17:08:22.671384 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writer thread running {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 17:08:22.709603 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO dbcounter [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Registered counter for database nova_api May 25 17:08:22.729192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.context [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a24b6412-6df0-4cb6-9852-3a2a26f5f191(cell1) {{(pid=117695) load_cells /opt/stack/nova/nova/context.py:464}} May 25 17:08:22.729946 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 17:08:22.733420 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:08:22.735031 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:08:22.735882 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:08:22.737638 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writer thread running {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 17:08:22.737924 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:08:22.740514 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO dbcounter [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Registered counter for database nova_cell0 May 25 17:08:22.744589 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO dbcounter [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Registered counter for database nova_cell1 May 25 17:08:22.751791 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_db.sqlalchemy.engines [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 17:08:22.754072 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_db.sqlalchemy.engines [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 17:08:22.760029 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writer thread running {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 17:08:22.762823 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writer thread running {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 17:08:22.795911 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.context [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a24b6412-6df0-4cb6-9852-3a2a26f5f191(cell1) {{(pid=117696) load_cells /opt/stack/nova/nova/context.py:464}} May 25 17:08:22.800124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:08:22.801787 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:08:22.803163 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:08:22.805263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:08:22.807304 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO dbcounter [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Registered counter for database nova_cell0 May 25 17:08:22.811360 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO dbcounter [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Registered counter for database nova_cell1 May 25 17:08:22.819239 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 17:08:22.821733 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 17:08:22.829002 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writer thread running {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 17:08:22.830293 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writer thread running {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 17:08:22.913366 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO dbcounter [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Registered counter for database nova_cell0 May 25 17:08:22.920045 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_db.sqlalchemy.engines [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 17:08:22.924485 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writer thread running {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 17:08:22.983358 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO dbcounter [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Registered counter for database nova_cell0 May 25 17:08:22.992427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 17:08:22.997928 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writer thread running {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 17:08:23.253702 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: WARNING keystonemiddleware.auth_token [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 17:08:23.261063 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: WARNING keystonemiddleware.auth_token [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 17:08:23.327516 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: WARNING keystonemiddleware.auth_token [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 17:08:23.335755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: WARNING keystonemiddleware.auth_token [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 17:08:23.611049 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: WARNING keystonemiddleware.auth_token [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 17:08:23.617168 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: WARNING keystonemiddleware.auth_token [None req-795af510-c7cd-4b2f-9172-5f1fde598f8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 17:08:23.622491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a41ff679c0 pid: 117695 (default app) May 25 17:08:23.683465 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: WARNING keystonemiddleware.auth_token [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 17:08:23.689795 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: WARNING keystonemiddleware.auth_token [None req-1bc08ed4-45c1-4c9d-b980-123e61e9bf3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 17:08:23.695798 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a41ff679c0 pid: 117696 (default app) May 25 17:09:05.502756 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=3 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.504159 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=3 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.505356 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=3 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.506335 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=3 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.812578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.814571 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.818213 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.819796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:06.952660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-03aea958-600b-4481-ba7f-ee5c24a9744d tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Action: 'create', calling method: .version_select at 0x7f3d50a14ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1528336650"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:07.812158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1717588638", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "networks": [{"uuid": "cd9aa901-6a70-4a5a-a91a-969e2210030b"}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:09.135538 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] validate_networks() for [('cd9aa901-6a70-4a5a-a91a-969e2210030b', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:09:09.662018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-03aea958-600b-4481-ba7f-ee5c24a9744d tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.167995 May 25 17:09:09.663438 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 1/1] 10.222.0.31 () {60 vars in 1154 bytes} [Wed May 25 17:09:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4171 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 17:09:09.675848 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f551a75a-054b-47e0-a10d-97d2a47f65d1 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d50863c10>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:09.866211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f551a75a-054b-47e0-a10d-97d2a47f65d1 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985" status: 200 len: 345 microversion: 2.1 time: 0.194296 May 25 17:09:09.875023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 2/2] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:09:09 2022] GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 => generated 345 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:10.881220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7c3a3fed-c77b-40d2-8b77-1f10e7a3617b tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d50863dc0>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:11.022279 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7c3a3fed-c77b-40d2-8b77-1f10e7a3617b tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985" status: 200 len: 346 microversion: 2.1 time: 0.145545 May 25 17:09:11.023092 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 3/3] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:09:10 2022] GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 => generated 346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:11.034406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ece0dead-7b7b-42f9-8e00-10a7f472f7d0 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Action: 'create', calling method: .version_select at 0x7f3d50879310>, body: {"snapshot": {"volume_id": "d85cdebc-6922-455e-9e89-b7683e27e985", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1232436818"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:11.482885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ece0dead-7b7b-42f9-8e00-10a7f472f7d0 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.452713 May 25 17:09:11.483718 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 4/4] 10.222.0.31 () {60 vars in 1161 bytes} [Wed May 25 17:09:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:11.493622 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5ed42fde-6396-480d-9ea3-8cffb1b29007 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d50879f70>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:11.613834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5ed42fde-6396-480d-9ea3-8cffb1b29007 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388" status: 200 len: 287 microversion: 2.1 time: 0.123333 May 25 17:09:11.614954 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 5/5] 10.222.0.31 () {58 vars in 1250 bytes} [Wed May 25 17:09:11 2022] GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:11.624378 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b6c373ee-48d0-40e6-a994-7d636b74e421 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d50879b80>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:11.720945 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b6c373ee-48d0-40e6-a994-7d636b74e421 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.099199 May 25 17:09:11.723750 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 6/6] 10.222.0.31 () {58 vars in 1139 bytes} [Wed May 25 17:09:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:11.733538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-01d88cb1-f0fc-4fe1-b9d1-2bb63b37b29b tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d50863a60>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:11.890230 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-01d88cb1-f0fc-4fe1-b9d1-2bb63b37b29b tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388" status: 200 len: 287 microversion: 2.1 time: 0.160472 May 25 17:09:11.895439 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 7/7] 10.222.0.31 () {58 vars in 1250 bytes} [Wed May 25 17:09:11 2022] GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388 => generated 287 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:12.338116 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:09:12.339113 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:09:12.339771 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:09:12.340326 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:09:12.341121 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:09:12.372581 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:12.375684 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:12.376898 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:12.377857 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:12.455298 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Getting quotas for project 23a454e276d3405a93a67513e1a12126. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:09:12.464136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Getting quotas for user 83e111e4a0df4636ac9dc837f511e487 and project 23a454e276d3405a93a67513e1a12126. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:09:12.480230 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:09:12.484569 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:09:12.670562 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-dfb5ddb2-4c04-46ce-82f9-e2517d11ea24 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.887234 May 25 17:09:12.672328 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 1/8] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:09:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 6891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 17:09:12.683898 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-09cee082-796a-45e3-876d-6a3d5267e232 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:12.684766 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-09cee082-796a-45e3-876d-6a3d5267e232 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:12.908433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-200b60cd-686e-4daf-992b-47ef32b966ad tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d50811b80>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:13.067582 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-200b60cd-686e-4daf-992b-47ef32b966ad tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388" status: 200 len: 287 microversion: 2.1 time: 0.167852 May 25 17:09:13.072483 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 2/9] 10.222.0.31 () {58 vars in 1250 bytes} [Wed May 25 17:09:12 2022] GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388 => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:13.116379 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-09cee082-796a-45e3-876d-6a3d5267e232 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:13.140326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-09cee082-796a-45e3-876d-6a3d5267e232 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1215 microversion: 2.1 time: 0.460892 May 25 17:09:13.141850 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 8/10] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:12 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1215 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:14.080042 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0f9b1a80-d62b-40c8-a95a-9644068a58ce tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d4f788790>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:14.160375 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3cfd0e7a-553b-4716-97b6-04322ee8a1cc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:14.161804 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3cfd0e7a-553b-4716-97b6-04322ee8a1cc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:14.219368 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0f9b1a80-d62b-40c8-a95a-9644068a58ce tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388" status: 200 len: 287 microversion: 2.1 time: 0.143409 May 25 17:09:14.220377 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 3/11] 10.222.0.31 () {58 vars in 1250 bytes} [Wed May 25 17:09:14 2022] GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388 => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:14.313761 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3cfd0e7a-553b-4716-97b6-04322ee8a1cc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:14.324121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3cfd0e7a-553b-4716-97b6-04322ee8a1cc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1215 microversion: 2.1 time: 0.169771 May 25 17:09:14.327971 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 9/12] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:14 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:15.233635 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3c1c2ce2-d5cd-436a-8c61-53c9c27dc8ef tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d4f788e50>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:15.295913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3c1c2ce2-d5cd-436a-8c61-53c9c27dc8ef tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388" status: 200 len: 288 microversion: 2.1 time: 0.066793 May 25 17:09:15.297487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 4/13] 10.222.0.31 () {58 vars in 1250 bytes} [Wed May 25 17:09:15 2022] GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388 => generated 288 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:15.309893 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-61df5702-eaa6-4a17-8ee3-66648331a126 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d50840d30>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:15.345444 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-184db94d-479d-47c6-97d3-b44946663d4b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:15.346055 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-184db94d-479d-47c6-97d3-b44946663d4b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:15.377485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-184db94d-479d-47c6-97d3-b44946663d4b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:15.377949 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-184db94d-479d-47c6-97d3-b44946663d4b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:15.378794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-184db94d-479d-47c6-97d3-b44946663d4b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:15.379240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-184db94d-479d-47c6-97d3-b44946663d4b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:15.454647 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-61df5702-eaa6-4a17-8ee3-66648331a126 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "DELETE /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388" status: 202 len: 0 microversion: 2.1 time: 0.149127 May 25 17:09:15.455699 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 10/14] 10.222.0.31 () {58 vars in 1253 bytes} [Wed May 25 17:09:15 2022] DELETE /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:09:15.464094 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-323cbe5b-8504-4f8d-9ba8-6f052ce1a9d4 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d5084a430>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:15.552754 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-323cbe5b-8504-4f8d-9ba8-6f052ce1a9d4 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388" status: 200 len: 287 microversion: 2.1 time: 0.092524 May 25 17:09:15.553849 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 11/15] 10.222.0.31 () {58 vars in 1250 bytes} [Wed May 25 17:09:15 2022] GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:16.367139 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-184db94d-479d-47c6-97d3-b44946663d4b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:16.392344 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-184db94d-479d-47c6-97d3-b44946663d4b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1211 microversion: 2.1 time: 1.050719 May 25 17:09:16.393497 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 5/16] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:15 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1211 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:16.569044 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-dacd12e8-72ce-4572-a44f-6b2539146eb5 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d50840f70>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:16.621906 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-dacd12e8-72ce-4572-a44f-6b2539146eb5 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] HTTP exception thrown: Snapshot 68f8fc22-3d6a-43a9-ad58-94b36dd43388 could not be found. May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-dacd12e8-72ce-4572-a44f-6b2539146eb5 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Request method failure captured: May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388 HTTP/1.1 May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmKx_MEEd2P5YBgxijrY1XFXJ_AvexQFd5JK_Y69a96zBS4UOSrrLPNPniwhZ6fsVSYl-5dN0JIOPgjn_iZXYpRouWSilEnfvN1KDvtWZEiSYzqLpSru0yXdQPohV2g5MsrTcnjBlhJOGpJTLppkot60rjviA5IRJWfLnUJmzF0hRtM May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 4f87f202405641b2aa2327efc35b6613 May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:09:16.626494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_4f87f202405641b2aa2327efc35b6613"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/4f87f202405641b2aa2327efc35b6613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/4f87f202405641b2aa2327efc35b6613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/4f87f202405641b2aa2327efc35b6613"}]}] May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 4f87f202405641b2aa2327efc35b6613 May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-VolumesSnapshotsTestJSON-105067499-project May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 26cf2c6695084b0894bbfd9d4047f36a May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-105067499-project May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Snapshot 68f8fc22-3d6a-43a9-ad58-94b36dd43388 could not be found. May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '68f8fc22-3d6a-43a9-ad58-94b36dd43388'} May 25 17:09:16.627901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 68f8fc22-3d6a-43a9-ad58-94b36dd43388 could not be found. (HTTP 404) (Request-ID: req-a0fca20d-01ae-4715-b27d-022e76190d27) May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:09:16.629313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 17:09:16.630333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 68f8fc22-3d6a-43a9-ad58-94b36dd43388 could not be found. May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 25 17:09:16.631494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 68f8fc22-3d6a-43a9-ad58-94b36dd43388 could not be found. May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 68f8fc22-3d6a-43a9-ad58-94b36dd43388 could not be found. May 25 17:09:16.632705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:09:16.633739 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-dacd12e8-72ce-4572-a44f-6b2539146eb5 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Returning 404 to user: Snapshot 68f8fc22-3d6a-43a9-ad58-94b36dd43388 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:09:16.634719 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-dacd12e8-72ce-4572-a44f-6b2539146eb5 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388" status: 404 len: 111 microversion: 2.1 time: 0.073866 May 25 17:09:16.635386 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 12/17] 10.222.0.31 () {58 vars in 1250 bytes} [Wed May 25 17:09:16 2022] GET /compute/v2.1/os-snapshots/68f8fc22-3d6a-43a9-ad58-94b36dd43388 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:09:16.650864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1ba5bd26-0e5a-4e4c-a1f1-03c7c0868034 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d4f70e5e0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:16.873263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1ba5bd26-0e5a-4e4c-a1f1-03c7c0868034 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985" status: 202 len: 0 microversion: 2.1 time: 0.232378 May 25 17:09:16.879425 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 6/18] 10.222.0.31 () {58 vars in 1247 bytes} [Wed May 25 17:09:16 2022] DELETE /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:09:16.887380 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d6df2742-0f89-47e0-ba69-b5ce719d6ee9 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d508791f0>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:17.043455 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d6df2742-0f89-47e0-ba69-b5ce719d6ee9 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985" status: 200 len: 345 microversion: 2.1 time: 0.161451 May 25 17:09:17.044323 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 13/19] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:09:16 2022] GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 => generated 345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:09:17.291820 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8e200f4c-17d6-4dd4-9bcc-e6dc398c893f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'create', calling method: .version_select at 0x7f3d4f788af0>, body: {"keypair": {"name": "tempest-keypair-1443351293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPpSm2ONn9+pHQwSAYcLWnF18IbN0hPZVMIQiHOeLj1XT//PT9DQh5z0fQcOBVmQx4OOr+7vrJ5H1pEvFX+DUE+AY+Y9QJ1l6st81jV49RnxFClvBbP1q/MlLNLAhk1qg=="}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:17.367266 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-8e200f4c-17d6-4dd4-9bcc-e6dc398c893f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Getting quotas for project 7691c75f7a3448e38a99489d3df21925. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:09:17.377828 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-8e200f4c-17d6-4dd4-9bcc-e6dc398c893f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Getting quotas for user 902f574061e64236ae8d6df08093c8e2 and project 7691c75f7a3448e38a99489d3df21925. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:09:17.417059 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-14c9b0b5-0bf0-4b8a-b3a2-f7d1f8fcd5b1 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:17.418276 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-14c9b0b5-0bf0-4b8a-b3a2-f7d1f8fcd5b1 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:17.435991 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-14c9b0b5-0bf0-4b8a-b3a2-f7d1f8fcd5b1 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:17.436525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-14c9b0b5-0bf0-4b8a-b3a2-f7d1f8fcd5b1 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:17.437663 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-14c9b0b5-0bf0-4b8a-b3a2-f7d1f8fcd5b1 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:17.438431 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-14c9b0b5-0bf0-4b8a-b3a2-f7d1f8fcd5b1 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:17.449948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8e200f4c-17d6-4dd4-9bcc-e6dc398c893f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.507641 May 25 17:09:17.450932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 7/20] 10.222.0.31 () {60 vars in 1158 bytes} [Wed May 25 17:09:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:17.799304 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-14c9b0b5-0bf0-4b8a-b3a2-f7d1f8fcd5b1 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:17.815365 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-14c9b0b5-0bf0-4b8a-b3a2-f7d1f8fcd5b1 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1273 microversion: 2.1 time: 0.408264 May 25 17:09:17.816834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 14/21] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:17 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1273 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:18.056997 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a0f8d0d8-527c-43c3-a6c3-b35369a227b6 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d4f6d28b0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:18.147473 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a0f8d0d8-527c-43c3-a6c3-b35369a227b6 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985" status: 200 len: 345 microversion: 2.1 time: 0.094484 May 25 17:09:18.148656 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 8/22] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:09:18 2022] GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 => generated 345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:18.835939 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-89c3e0c0-1976-4e25-8217-bbd1f9b4f469 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:18.837169 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-89c3e0c0-1976-4e25-8217-bbd1f9b4f469 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:18.849867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89c3e0c0-1976-4e25-8217-bbd1f9b4f469 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:18.851966 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89c3e0c0-1976-4e25-8217-bbd1f9b4f469 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:18.856435 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89c3e0c0-1976-4e25-8217-bbd1f9b4f469 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:18.857130 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89c3e0c0-1976-4e25-8217-bbd1f9b4f469 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:19.042291 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-89c3e0c0-1976-4e25-8217-bbd1f9b4f469 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:19.055505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-89c3e0c0-1976-4e25-8217-bbd1f9b4f469 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1273 microversion: 2.1 time: 0.224814 May 25 17:09:19.056408 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 15/23] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:18 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:19.163613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a59a1051-08e9-424a-a62c-d0616d2f8270 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d4f6d2f70>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:19.278381 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a59a1051-08e9-424a-a62c-d0616d2f8270 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985" status: 200 len: 345 microversion: 2.1 time: 0.121598 May 25 17:09:19.279318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 9/24] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:09:19 2022] GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:20.074257 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-35bc7a01-7270-4cc9-bf08-192f34861954 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:20.074257 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-35bc7a01-7270-4cc9-bf08-192f34861954 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:20.099302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-35bc7a01-7270-4cc9-bf08-192f34861954 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:20.105214 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-35bc7a01-7270-4cc9-bf08-192f34861954 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:20.106192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-35bc7a01-7270-4cc9-bf08-192f34861954 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:20.106860 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-35bc7a01-7270-4cc9-bf08-192f34861954 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:20.291764 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-32bcbe69-40c5-4b64-bb4f-d207bdf29847 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d4f67a670>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:20.380895 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-32bcbe69-40c5-4b64-bb4f-d207bdf29847 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] HTTP exception thrown: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-32bcbe69-40c5-4b64-bb4f-d207bdf29847 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Request method failure captured: May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 HTTP/1.1 May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmKx_MEEd2P5YBgxijrY1XFXJ_AvexQFd5JK_Y69a96zBS4UOSrrLPNPniwhZ6fsVSYl-5dN0JIOPgjn_iZXYpRouWSilEnfvN1KDvtWZEiSYzqLpSru0yXdQPohV2g5MsrTcnjBlhJOGpJTLppkot60rjviA5IRJWfLnUJmzF0hRtM May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 4f87f202405641b2aa2327efc35b6613 May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:09:20.385319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_4f87f202405641b2aa2327efc35b6613"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/4f87f202405641b2aa2327efc35b6613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/4f87f202405641b2aa2327efc35b6613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/4f87f202405641b2aa2327efc35b6613"}]}] May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 4f87f202405641b2aa2327efc35b6613 May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesSnapshotsTestJSON-105067499-project May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 26cf2c6695084b0894bbfd9d4047f36a May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-105067499-project May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'd85cdebc-6922-455e-9e89-b7683e27e985'} May 25 17:09:20.386427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. (HTTP 404) (Request-ID: req-530a982a-2ef5-4fdd-a518-b76c5644e1d8) May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:20.387096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 17:09:20.388193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 17:09:20.389211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-32bcbe69-40c5-4b64-bb4f-d207bdf29847 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Returning 404 to user: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-32bcbe69-40c5-4b64-bb4f-d207bdf29847 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985" status: 404 len: 109 microversion: 2.1 time: 0.099408 May 25 17:09:20.390178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 10/25] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:09:20 2022] GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:09:20.405363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1728e4f1-9133-4642-8775-904bad56a8ec tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d4f67ad30>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:20.516361 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-1728e4f1-9133-4642-8775-904bad56a8ec tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] HTTP exception thrown: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1728e4f1-9133-4642-8775-904bad56a8ec tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Request method failure captured: May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 HTTP/1.1 May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmKx_MEEd2P5YBgxijrY1XFXJ_AvexQFd5JK_Y69a96zBS4UOSrrLPNPniwhZ6fsVSYl-5dN0JIOPgjn_iZXYpRouWSilEnfvN1KDvtWZEiSYzqLpSru0yXdQPohV2g5MsrTcnjBlhJOGpJTLppkot60rjviA5IRJWfLnUJmzF0hRtM May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 4f87f202405641b2aa2327efc35b6613 May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:09:20.518490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_4f87f202405641b2aa2327efc35b6613"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/4f87f202405641b2aa2327efc35b6613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/4f87f202405641b2aa2327efc35b6613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/4f87f202405641b2aa2327efc35b6613"}]}] May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 4f87f202405641b2aa2327efc35b6613 May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesSnapshotsTestJSON-105067499-project May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 26cf2c6695084b0894bbfd9d4047f36a May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-105067499-project May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'd85cdebc-6922-455e-9e89-b7683e27e985'} May 25 17:09:20.520020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. (HTTP 404) (Request-ID: req-fb966c04-8acb-48df-a450-1ff9ce383247) May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:20.520907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 17:09:20.522227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 17:09:20.523352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1728e4f1-9133-4642-8775-904bad56a8ec tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Returning 404 to user: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1728e4f1-9133-4642-8775-904bad56a8ec tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985" status: 404 len: 109 microversion: 2.1 time: 0.118948 May 25 17:09:20.524343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 11/26] 10.222.0.31 () {58 vars in 1247 bytes} [Wed May 25 17:09:20 2022] DELETE /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:09:20.545101 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8efc0b80-72a0-47d2-929d-3478f62cdcd8 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Calling method '.version_select at 0x7f3d4f67ae50>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:20.583121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-35bc7a01-7270-4cc9-bf08-192f34861954 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:20.591786 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-35bc7a01-7270-4cc9-bf08-192f34861954 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1273 microversion: 2.1 time: 0.522490 May 25 17:09:20.592385 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 16/27] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:20 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1273 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:20.622002 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-8efc0b80-72a0-47d2-929d-3478f62cdcd8 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] HTTP exception thrown: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8efc0b80-72a0-47d2-929d-3478f62cdcd8 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Request method failure captured: May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 HTTP/1.1 May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmKx_MEEd2P5YBgxijrY1XFXJ_AvexQFd5JK_Y69a96zBS4UOSrrLPNPniwhZ6fsVSYl-5dN0JIOPgjn_iZXYpRouWSilEnfvN1KDvtWZEiSYzqLpSru0yXdQPohV2g5MsrTcnjBlhJOGpJTLppkot60rjviA5IRJWfLnUJmzF0hRtM May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 4f87f202405641b2aa2327efc35b6613 May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:09:20.624136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_4f87f202405641b2aa2327efc35b6613"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/4f87f202405641b2aa2327efc35b6613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/4f87f202405641b2aa2327efc35b6613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/4f87f202405641b2aa2327efc35b6613"}]}] May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 4f87f202405641b2aa2327efc35b6613 May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-105067499 May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesSnapshotsTestJSON-105067499-project May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 26cf2c6695084b0894bbfd9d4047f36a May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-105067499-project May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'd85cdebc-6922-455e-9e89-b7683e27e985'} May 25 17:09:20.625363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. (HTTP 404) (Request-ID: req-d048b528-9eef-4a35-b92a-efdd8b215c5d) May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:20.626068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 17:09:20.626985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 17:09:20.627983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. May 25 17:09:20.628934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:09:20.630614 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8efc0b80-72a0-47d2-929d-3478f62cdcd8 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] Returning 404 to user: Volume d85cdebc-6922-455e-9e89-b7683e27e985 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:09:20.633403 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8efc0b80-72a0-47d2-929d-3478f62cdcd8 tempest-VolumesSnapshotsTestJSON-105067499 tempest-VolumesSnapshotsTestJSON-105067499-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985" status: 404 len: 109 microversion: 2.1 time: 0.105096 May 25 17:09:20.640488 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 12/28] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:09:20 2022] GET /compute/v2.1/os-volumes/d85cdebc-6922-455e-9e89-b7683e27e985 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:09:21.615186 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e3dea302-07a9-4a2a-be67-ae47b38335d6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:21.616407 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e3dea302-07a9-4a2a-be67-ae47b38335d6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:21.631151 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e3dea302-07a9-4a2a-be67-ae47b38335d6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:21.631606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e3dea302-07a9-4a2a-be67-ae47b38335d6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:21.636080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e3dea302-07a9-4a2a-be67-ae47b38335d6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:21.654195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e3dea302-07a9-4a2a-be67-ae47b38335d6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:22.186113 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e3dea302-07a9-4a2a-be67-ae47b38335d6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:22.209011 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e3dea302-07a9-4a2a-be67-ae47b38335d6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1273 microversion: 2.1 time: 0.597510 May 25 17:09:22.212235 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 17/29] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:21 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1273 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:23.227586 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-032f29b1-1174-44b0-8376-9a1eb267ed70 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:23.228323 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-032f29b1-1174-44b0-8376-9a1eb267ed70 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:23.239287 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:23.256670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-032f29b1-1174-44b0-8376-9a1eb267ed70 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:23.257496 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-032f29b1-1174-44b0-8376-9a1eb267ed70 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:23.258467 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-032f29b1-1174-44b0-8376-9a1eb267ed70 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:23.258957 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-032f29b1-1174-44b0-8376-9a1eb267ed70 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:23.656321 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-032f29b1-1174-44b0-8376-9a1eb267ed70 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:23.668998 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-032f29b1-1174-44b0-8376-9a1eb267ed70 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1273 microversion: 2.1 time: 0.445136 May 25 17:09:23.669608 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 13/30] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:23 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1273 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:24.693645 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8225467a-b8fa-4a4a-988d-2d30842000d9 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:24.694257 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8225467a-b8fa-4a4a-988d-2d30842000d9 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:24.708587 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=4 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:24.710321 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8225467a-b8fa-4a4a-988d-2d30842000d9 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:24.710774 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8225467a-b8fa-4a4a-988d-2d30842000d9 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:24.711554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8225467a-b8fa-4a4a-988d-2d30842000d9 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:24.711993 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8225467a-b8fa-4a4a-988d-2d30842000d9 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:25.062767 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8225467a-b8fa-4a4a-988d-2d30842000d9 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:25.093736 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8225467a-b8fa-4a4a-988d-2d30842000d9 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1273 microversion: 2.1 time: 0.410382 May 25 17:09:25.104661 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 18/31] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:24 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1273 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:26.123764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6bd11105-f7c7-4d43-aa24-4084747e8572 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:26.124464 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6bd11105-f7c7-4d43-aa24-4084747e8572 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:26.151514 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6bd11105-f7c7-4d43-aa24-4084747e8572 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:26.151976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6bd11105-f7c7-4d43-aa24-4084747e8572 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:26.152786 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6bd11105-f7c7-4d43-aa24-4084747e8572 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:26.153228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6bd11105-f7c7-4d43-aa24-4084747e8572 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:26.211156 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b0950b9d-6daa-4b40-b3bc-e459c035f4bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Action: 'create', calling method: .version_select at 0x7f3d4edf8550>, body: {"keypair": {"name": "tempest-keypair-579287270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpL2UdJOGiIBo1oHxdI1rnnG4xeQ8QXC51frgbIY/6x2gTpi6sP0Q+dvgodIyZgcewxSCOVrDqLSs0MIx+BjKCXmvO25hDPnXYbJeY6aGvibwN9vXqdgyXAFyFfGBTe7A=="}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:26.263274 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-b0950b9d-6daa-4b40-b3bc-e459c035f4bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Getting quotas for project 197671139e6b42069ba82ea9fdf1da40. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:09:26.303492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-b0950b9d-6daa-4b40-b3bc-e459c035f4bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Getting quotas for user 41618b0540e64de4b968d5cdc39bea0a and project 197671139e6b42069ba82ea9fdf1da40. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:09:26.374988 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b0950b9d-6daa-4b40-b3bc-e459c035f4bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.191863 May 25 17:09:26.375597 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 14/32] 10.222.0.31 () {62 vars in 1199 bytes} [Wed May 25 17:09:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1193 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 25 17:09:27.411864 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6bd11105-f7c7-4d43-aa24-4084747e8572 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:27.424297 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6bd11105-f7c7-4d43-aa24-4084747e8572 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 1.302757 May 25 17:09:27.425402 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 19/33] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:26 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:27.764036 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1039104316", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:27.876175 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] validate_networks() for [('79368167-854c-4f50-95fb-3c054bede279', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:09:28.452667 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d314e737-17be-498f-a42c-58fd3bcfeffc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:28.453323 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d314e737-17be-498f-a42c-58fd3bcfeffc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:28.468945 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d314e737-17be-498f-a42c-58fd3bcfeffc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:28.491039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d314e737-17be-498f-a42c-58fd3bcfeffc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:28.502015 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d314e737-17be-498f-a42c-58fd3bcfeffc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:28.504900 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d314e737-17be-498f-a42c-58fd3bcfeffc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:29.141310 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d314e737-17be-498f-a42c-58fd3bcfeffc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:29.157561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d314e737-17be-498f-a42c-58fd3bcfeffc tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 0.719653 May 25 17:09:29.158159 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 20/34] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:28 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:29.185183 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1524661353", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d76a1c5f-4c89-4d32-84e7-0dba2627dce6"}], "security_groups": [{"name": "tempest-securitygroup--1584203857"}], "key_name": "tempest-keypair-1443351293", "user_data": "}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:29.881619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.network.neutron [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] validate_networks() for [('d76a1c5f-4c89-4d32-84e7-0dba2627dce6', None, None, None, None, None)] {{(pid=117695) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:09:31.322303 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:09:31.322840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:09:31.323239 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:09:31.323627 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:09:31.324030 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:09:31.350857 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:31.351305 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:31.352122 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:31.352570 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:31.461775 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Getting quotas for project 8c297ec7b46943f594b67c95479f1f7c. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:09:31.490818 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Getting quotas for user 3f51c03f7fe54451b49ddb32fc337b98 and project 8c297ec7b46943f594b67c95479f1f7c. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:09:31.543856 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:09:31.546551 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:09:31.797641 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-110e6b52-1e5f-4b8c-a73c-5f79d07c8b50 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.615223 May 25 17:09:31.798424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 15/35] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:09:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 4618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 17:09:31.858053 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f460892c-0c6c-46bf-b6db-5561163d56ba tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:31.866930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f460892c-0c6c-46bf-b6db-5561163d56ba tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:31.917228 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f460892c-0c6c-46bf-b6db-5561163d56ba tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:31.924063 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f460892c-0c6c-46bf-b6db-5561163d56ba tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:31.927794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f460892c-0c6c-46bf-b6db-5561163d56ba tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:31.949193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f460892c-0c6c-46bf-b6db-5561163d56ba tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:33.144099 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Flavor limits 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:09:33.145754 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Image limits 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:09:33.146703 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Flavor pref 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:09:33.147828 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Image pref 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:09:33.148930 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:09:33.185442 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:33.186299 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:33.187499 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:33.188284 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:33.288269 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Getting quotas for project 7691c75f7a3448e38a99489d3df21925. Resources: {'ram', 'instances', 'cores'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:09:33.310555 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Getting quotas for user 902f574061e64236ae8d6df08093c8e2 and project 7691c75f7a3448e38a99489d3df21925. Resources: {'ram', 'instances', 'cores'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:09:33.364729 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Going to run 1 instances... {{(pid=117695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:09:33.376943 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:09:33.650808 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-68a6be65-54a8-46a2-b116-4b15d833524c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.481832 May 25 17:09:33.654937 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 21/36] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:09:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 4487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:09:33.682605 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6490780c-2441-4456-81d5-721bbe542d21 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:33.690189 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6490780c-2441-4456-81d5-721bbe542d21 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:33.996166 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6490780c-2441-4456-81d5-721bbe542d21 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:34.007708 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6490780c-2441-4456-81d5-721bbe542d21 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1222 microversion: 2.1 time: 0.344486 May 25 17:09:34.009101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 22/37] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:33 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1222 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:34.027636 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f460892c-0c6c-46bf-b6db-5561163d56ba tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:34.048124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f460892c-0c6c-46bf-b6db-5561163d56ba tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 2.230478 May 25 17:09:34.070732 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 16/38] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:31 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:34.109801 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ad56277-8660-4926-9101-8ad683c97330 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:34.110550 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0ad56277-8660-4926-9101-8ad683c97330 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:34.234612 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-15c01394-0f9d-4f88-a960-d9b3f91f5ba8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: .version_select at 0x7f3d50654940>, body: {"keypair": {"name": "tempest-keypair-1054022931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFAi/zqCVgXP7eC1qZBm66W+6/88JRu7J2mgvbE+dr3S7h4WMC7va4h14v67wamUYwDtAVf86dv+XaYZSYsiRzK73jgxE4KzMk3JzYTuPnKeA+0alxwbdbXkmbc8NiZng=="}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:34.321879 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-15c01394-0f9d-4f88-a960-d9b3f91f5ba8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:09:34.359355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-15c01394-0f9d-4f88-a960-d9b3f91f5ba8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for user 3fb5eecf3e244058905ea3aba8112320 and project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:09:34.497923 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-15c01394-0f9d-4f88-a960-d9b3f91f5ba8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.487289 May 25 17:09:34.507857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 23/39] 10.222.0.31 () {60 vars in 1158 bytes} [Wed May 25 17:09:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:34.728002 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-3e99d970-1d77-4af2-af1a-ece9c3bc8910 req-0ed16cc9-702b-41d0-82a1-9e98bf22b1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a815e8-f0d5-4121-9124-d96e02afa8b2", "tag": "adbfec7d-46e1-477d-8236-36f39e8d299f"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:34.754694 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-3e99d970-1d77-4af2-af1a-ece9c3bc8910 req-0ed16cc9-702b-41d0-82a1-9e98bf22b1ed service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:34.782161 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-3e99d970-1d77-4af2-af1a-ece9c3bc8910 req-0ed16cc9-702b-41d0-82a1-9e98bf22b1ed service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:34.866318 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-3e99d970-1d77-4af2-af1a-ece9c3bc8910 req-0ed16cc9-702b-41d0-82a1-9e98bf22b1ed service nova] Creating event network-changed:adbfec7d-46e1-477d-8236-36f39e8d299f for instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 on hv-cinder-84330 May 25 17:09:34.875370 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-3e99d970-1d77-4af2-af1a-ece9c3bc8910 req-0ed16cc9-702b-41d0-82a1-9e98bf22b1ed service nova] Acquired lock "compute-rpcapi-router" {{(pid=117695) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 17:09:34.882615 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0ad56277-8660-4926-9101-8ad683c97330 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:34.882828 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-34a2559c-f1cf-486c-8e0b-4d53df54802a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:34.883445 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-34a2559c-f1cf-486c-8e0b-4d53df54802a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:34.886378 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-34a2559c-f1cf-486c-8e0b-4d53df54802a None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:34.887161 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-34a2559c-f1cf-486c-8e0b-4d53df54802a None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:34.895927 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0ad56277-8660-4926-9101-8ad683c97330 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1238 microversion: 2.1 time: 0.823443 May 25 17:09:34.902220 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 17/40] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:34 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1238 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:34.913041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-605681878", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:34.930544 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.compute.rpcapi [None req-34a2559c-f1cf-486c-8e0b-4d53df54802a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 17:09:34.938060 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-34a2559c-f1cf-486c-8e0b-4d53df54802a None None] Releasing lock "compute-rpcapi-router" {{(pid=117695) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 17:09:34.993355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-34a2559c-f1cf-486c-8e0b-4d53df54802a None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.483232 May 25 17:09:34.994583 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 24/41] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:35.075025 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5f5d78c4-ee76-4945-9bcf-9222f3a80b9e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:35.076044 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5f5d78c4-ee76-4945-9bcf-9222f3a80b9e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:35.087514 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] validate_networks() for [('79368167-854c-4f50-95fb-3c054bede279', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:09:35.092189 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5f5d78c4-ee76-4945-9bcf-9222f3a80b9e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:35.092984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5f5d78c4-ee76-4945-9bcf-9222f3a80b9e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:35.094116 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5f5d78c4-ee76-4945-9bcf-9222f3a80b9e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:35.096209 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5f5d78c4-ee76-4945-9bcf-9222f3a80b9e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:35.930153 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5f5d78c4-ee76-4945-9bcf-9222f3a80b9e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:35.943517 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5f5d78c4-ee76-4945-9bcf-9222f3a80b9e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 0.870213 May 25 17:09:35.945927 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 25/42] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:35 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:35.972158 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1677812578", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8771ee30-f2eb-41ac-813c-a5d3ee111699"}], "security_groups": [{"name": "tempest-securitygroup--460083875"}], "key_name": "tempest-keypair-579287270", "user_data": "}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:36.007630 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:36.253349 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.network.neutron [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] validate_networks() for [('8771ee30-f2eb-41ac-813c-a5d3ee111699', None, None, None, None, None)] {{(pid=117695) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:09:37.169634 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:09:37.171288 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:09:37.172372 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:09:37.173042 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:09:37.173665 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:09:37.179271 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=8 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:37.187366 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=23 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:37.189501 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:37.190653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:37.192338 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:37.193001 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:37.211300 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=23 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:37.243934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Getting quotas for project 8c297ec7b46943f594b67c95479f1f7c. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:09:37.249142 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Getting quotas for user 3f51c03f7fe54451b49ddb32fc337b98 and project 8c297ec7b46943f594b67c95479f1f7c. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:09:37.267503 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:09:37.279371 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:09:37.374688 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2efe79cb-f9b2-4036-b227-9bec618c2e11 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.469733 May 25 17:09:37.377066 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 18/43] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:09:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:09:37.390982 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-20c3d7e1-fe2f-4058-a9d9-219492699aff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:37.393247 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-20c3d7e1-fe2f-4058-a9d9-219492699aff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:37.407407 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-20c3d7e1-fe2f-4058-a9d9-219492699aff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:37.407872 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-20c3d7e1-fe2f-4058-a9d9-219492699aff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:37.408745 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-20c3d7e1-fe2f-4058-a9d9-219492699aff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:37.409232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-20c3d7e1-fe2f-4058-a9d9-219492699aff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:37.654517 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Flavor limits 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:09:37.655020 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Image limits 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:09:37.655497 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Flavor pref 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:09:37.655974 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Image pref 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:09:37.656411 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:09:37.689587 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:37.690951 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:37.693874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:37.696428 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:37.750597 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Getting quotas for project 197671139e6b42069ba82ea9fdf1da40. Resources: {'ram', 'instances', 'cores'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:09:37.758922 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Getting quotas for user 41618b0540e64de4b968d5cdc39bea0a and project 197671139e6b42069ba82ea9fdf1da40. Resources: {'ram', 'instances', 'cores'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:09:37.786690 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-20c3d7e1-fe2f-4058-a9d9-219492699aff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:37.794929 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Going to run 1 instances... {{(pid=117695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:09:37.798118 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-20c3d7e1-fe2f-4058-a9d9-219492699aff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1296 microversion: 2.1 time: 0.417605 May 25 17:09:37.798889 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:09:37.803412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 19/44] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:37 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1296 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:37.828134 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ef4e45d9-9b16-4941-a2c3-fb99489f36ef tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:37.828936 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ef4e45d9-9b16-4941-a2c3-fb99489f36ef tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:37.845703 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ef4e45d9-9b16-4941-a2c3-fb99489f36ef tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:37.849772 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ef4e45d9-9b16-4941-a2c3-fb99489f36ef tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:37.852393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ef4e45d9-9b16-4941-a2c3-fb99489f36ef tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:37.855365 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ef4e45d9-9b16-4941-a2c3-fb99489f36ef tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:37.957029 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ef667c5d-ed02-4c85-84c6-5cd5bdb1f435 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.005836 May 25 17:09:37.961064 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 26/45] 10.222.0.31 () {62 vars in 1187 bytes} [Wed May 25 17:09:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 2014 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 17:09:37.969116 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-915b7551-5fa3-46f6-98e8-dc57ca68c1fa tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:37.969679 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-915b7551-5fa3-46f6-98e8-dc57ca68c1fa tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:38.238673 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-915b7551-5fa3-46f6-98e8-dc57ca68c1fa tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:38.246091 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-915b7551-5fa3-46f6-98e8-dc57ca68c1fa tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1221 microversion: 2.1 time: 0.283447 May 25 17:09:38.246888 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 27/46] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:37 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1221 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:38.251889 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6b121eb4-d1d3-4501-98f1-2032b513d305 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:38.256159 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6b121eb4-d1d3-4501-98f1-2032b513d305 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:38.376164 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6b121eb4-d1d3-4501-98f1-2032b513d305 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:38.384879 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6b121eb4-d1d3-4501-98f1-2032b513d305 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:38.393101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6b121eb4-d1d3-4501-98f1-2032b513d305 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:38.395145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6b121eb4-d1d3-4501-98f1-2032b513d305 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1281 microversion: 2.20 time: 0.147068 May 25 17:09:38.397635 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 28/47] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:38 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1281 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:38.821435 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5c6a81a3-6fbe-45c3-9ea3-fcec8816e20c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:38.822150 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5c6a81a3-6fbe-45c3-9ea3-fcec8816e20c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:38.836928 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c6a81a3-6fbe-45c3-9ea3-fcec8816e20c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:38.837389 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c6a81a3-6fbe-45c3-9ea3-fcec8816e20c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:38.838184 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c6a81a3-6fbe-45c3-9ea3-fcec8816e20c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:38.838631 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c6a81a3-6fbe-45c3-9ea3-fcec8816e20c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:39.902047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5c6a81a3-6fbe-45c3-9ea3-fcec8816e20c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:39.918443 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5c6a81a3-6fbe-45c3-9ea3-fcec8816e20c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1296 microversion: 2.1 time: 1.100691 May 25 17:09:39.919293 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 29/48] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:38 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1296 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:39.934200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a47a67a6-c3b3-4348-a874-f4884f94e8bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:39.935052 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a47a67a6-c3b3-4348-a874-f4884f94e8bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:39.953314 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a47a67a6-c3b3-4348-a874-f4884f94e8bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:39.954992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ef4e45d9-9b16-4941-a2c3-fb99489f36ef tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:39.956572 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a47a67a6-c3b3-4348-a874-f4884f94e8bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:39.959422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a47a67a6-c3b3-4348-a874-f4884f94e8bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:39.960286 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a47a67a6-c3b3-4348-a874-f4884f94e8bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:39.966562 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ef4e45d9-9b16-4941-a2c3-fb99489f36ef tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 2.150529 May 25 17:09:39.971724 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 20/49] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:37 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:39.983794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d1a36f62-fb4d-469e-b1a8-41474a92356a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:39.984483 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d1a36f62-fb4d-469e-b1a8-41474a92356a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:39.998545 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1a36f62-fb4d-469e-b1a8-41474a92356a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:39.999186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1a36f62-fb4d-469e-b1a8-41474a92356a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:40.000620 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1a36f62-fb4d-469e-b1a8-41474a92356a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:40.002207 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1a36f62-fb4d-469e-b1a8-41474a92356a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:40.116161 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a47a67a6-c3b3-4348-a874-f4884f94e8bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:40.125062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a47a67a6-c3b3-4348-a874-f4884f94e8bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1279 microversion: 2.1 time: 0.204373 May 25 17:09:40.128236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 30/50] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:39 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:40.165175 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d1a36f62-fb4d-469e-b1a8-41474a92356a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:40.173672 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d1a36f62-fb4d-469e-b1a8-41474a92356a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:40.178597 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d1a36f62-fb4d-469e-b1a8-41474a92356a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:40.182224 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d1a36f62-fb4d-469e-b1a8-41474a92356a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1333 microversion: 2.20 time: 0.208917 May 25 17:09:40.184528 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 21/51] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:39 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1333 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:40.935953 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b13dd272-83b5-48d5-925e-bcacd4af5fc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:40.937177 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b13dd272-83b5-48d5-925e-bcacd4af5fc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:40.953269 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b13dd272-83b5-48d5-925e-bcacd4af5fc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:40.953636 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b13dd272-83b5-48d5-925e-bcacd4af5fc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:40.954424 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b13dd272-83b5-48d5-925e-bcacd4af5fc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:40.954866 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b13dd272-83b5-48d5-925e-bcacd4af5fc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:40.991374 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-65aa00a0-1d47-439c-9a1d-2bfac50099e6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:40.992252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-65aa00a0-1d47-439c-9a1d-2bfac50099e6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:41.008647 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65aa00a0-1d47-439c-9a1d-2bfac50099e6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:41.009258 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65aa00a0-1d47-439c-9a1d-2bfac50099e6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:41.010051 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65aa00a0-1d47-439c-9a1d-2bfac50099e6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:41.010512 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65aa00a0-1d47-439c-9a1d-2bfac50099e6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:41.289746 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-65aa00a0-1d47-439c-9a1d-2bfac50099e6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:41.302136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-65aa00a0-1d47-439c-9a1d-2bfac50099e6 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 0.318320 May 25 17:09:41.302654 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 22/52] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:40 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:41.313854 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-15565106-fbb5-4fb8-be53-223c3eabd668 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:41.326613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-15565106-fbb5-4fb8-be53-223c3eabd668 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:41.332434 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15565106-fbb5-4fb8-be53-223c3eabd668 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:41.333134 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15565106-fbb5-4fb8-be53-223c3eabd668 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:41.333885 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15565106-fbb5-4fb8-be53-223c3eabd668 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:41.334315 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15565106-fbb5-4fb8-be53-223c3eabd668 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:41.489741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b13dd272-83b5-48d5-925e-bcacd4af5fc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:41.503710 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b13dd272-83b5-48d5-925e-bcacd4af5fc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.571448 May 25 17:09:41.505717 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 31/53] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:40 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:41.535425 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-416648bd-d99a-46ad-ab0b-e6ba01530293 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:41.542401 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-416648bd-d99a-46ad-ab0b-e6ba01530293 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:41.543662 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-15565106-fbb5-4fb8-be53-223c3eabd668 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:41.554492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-15565106-fbb5-4fb8-be53-223c3eabd668 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1279 microversion: 2.1 time: 0.249165 May 25 17:09:41.555473 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 23/54] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:41 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:41.569918 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-416648bd-d99a-46ad-ab0b-e6ba01530293 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:41.571234 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-416648bd-d99a-46ad-ab0b-e6ba01530293 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:41.572752 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-416648bd-d99a-46ad-ab0b-e6ba01530293 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:41.574705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-416648bd-d99a-46ad-ab0b-e6ba01530293 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:42.320323 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-81da7c8c-3521-45ef-be46-6f4a6dd34d98 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:42.321201 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-81da7c8c-3521-45ef-be46-6f4a6dd34d98 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:42.331837 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81da7c8c-3521-45ef-be46-6f4a6dd34d98 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:42.332566 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81da7c8c-3521-45ef-be46-6f4a6dd34d98 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:42.333506 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81da7c8c-3521-45ef-be46-6f4a6dd34d98 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:42.337448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81da7c8c-3521-45ef-be46-6f4a6dd34d98 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:42.431003 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-416648bd-d99a-46ad-ab0b-e6ba01530293 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:42.443858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-416648bd-d99a-46ad-ab0b-e6ba01530293 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:42.452153 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-416648bd-d99a-46ad-ab0b-e6ba01530293 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:42.464368 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-416648bd-d99a-46ad-ab0b-e6ba01530293 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1333 microversion: 2.20 time: 0.944631 May 25 17:09:42.465684 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 32/55] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:41 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1333 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:42.523619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-17056c87-a27a-436e-928f-2dff9375466c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:42.524499 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-17056c87-a27a-436e-928f-2dff9375466c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:42.537495 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17056c87-a27a-436e-928f-2dff9375466c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:42.541197 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17056c87-a27a-436e-928f-2dff9375466c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:42.545104 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17056c87-a27a-436e-928f-2dff9375466c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:42.545564 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17056c87-a27a-436e-928f-2dff9375466c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:43.153523 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-17056c87-a27a-436e-928f-2dff9375466c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:43.162357 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-17056c87-a27a-436e-928f-2dff9375466c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.642694 May 25 17:09:43.166100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 33/56] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:42 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:43.172085 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0b5b140b-c4f4-49da-9602-bafc763656e9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:43.172953 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0b5b140b-c4f4-49da-9602-bafc763656e9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:43.192938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b5b140b-c4f4-49da-9602-bafc763656e9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:43.195208 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b5b140b-c4f4-49da-9602-bafc763656e9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:43.196247 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b5b140b-c4f4-49da-9602-bafc763656e9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:43.198267 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b5b140b-c4f4-49da-9602-bafc763656e9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:43.306629 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0b5b140b-c4f4-49da-9602-bafc763656e9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:43.325531 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0b5b140b-c4f4-49da-9602-bafc763656e9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1279 microversion: 2.1 time: 0.158086 May 25 17:09:43.326699 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 34/57] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:43 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:43.405656 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-81da7c8c-3521-45ef-be46-6f4a6dd34d98 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:43.421279 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-81da7c8c-3521-45ef-be46-6f4a6dd34d98 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 1.104335 May 25 17:09:43.422770 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 24/58] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:42 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:43.430188 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-258492942", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94689dfe-6d66-4ed0-9452-eee0a515d2d3"}], "security_groups": [{"name": "tempest-securitygroup--1904226382"}], "key_name": "tempest-keypair-1054022931", "user_data": "}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:43.448455 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-5b7709de-2f0b-46aa-8369-9b2b2b3bba4e req-e1b53cf8-a26d-4fae-aa4e-d7bfbf088acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f434295-7a0d-4d51-8f4e-6698b399b20a", "tag": "3c00686d-3bd0-4e09-a004-2c18e278c159"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:43.468506 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-5b7709de-2f0b-46aa-8369-9b2b2b3bba4e req-e1b53cf8-a26d-4fae-aa4e-d7bfbf088acb service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:43.469874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-5b7709de-2f0b-46aa-8369-9b2b2b3bba4e req-e1b53cf8-a26d-4fae-aa4e-d7bfbf088acb service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:43.493342 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-5b7709de-2f0b-46aa-8369-9b2b2b3bba4e req-e1b53cf8-a26d-4fae-aa4e-d7bfbf088acb service nova] Creating event network-changed:3c00686d-3bd0-4e09-a004-2c18e278c159 for instance 8f434295-7a0d-4d51-8f4e-6698b399b20a on hv-cinder-84330 May 25 17:09:43.505690 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-5b7709de-2f0b-46aa-8369-9b2b2b3bba4e req-e1b53cf8-a26d-4fae-aa4e-d7bfbf088acb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177595 May 25 17:09:43.506543 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 35/59] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:43.512428 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5523c001-664d-47b7-9544-b2604eb1e160 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:43.513296 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5523c001-664d-47b7-9544-b2604eb1e160 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:43.521915 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5523c001-664d-47b7-9544-b2604eb1e160 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:43.522958 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5523c001-664d-47b7-9544-b2604eb1e160 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:43.523603 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5523c001-664d-47b7-9544-b2604eb1e160 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:43.524972 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5523c001-664d-47b7-9544-b2604eb1e160 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:43.648925 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5523c001-664d-47b7-9544-b2604eb1e160 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:43.656090 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=100 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:43.670177 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5523c001-664d-47b7-9544-b2604eb1e160 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:43.674374 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5523c001-664d-47b7-9544-b2604eb1e160 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:43.675908 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5523c001-664d-47b7-9544-b2604eb1e160 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1339 microversion: 2.20 time: 0.168094 May 25 17:09:43.685701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 36/60] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:43 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1339 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:43.871335 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] validate_networks() for [('94689dfe-6d66-4ed0-9452-eee0a515d2d3', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:09:44.181727 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7fb6b481-28f4-4ede-a341-77d112d0624c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:44.182535 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7fb6b481-28f4-4ede-a341-77d112d0624c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:44.199005 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7fb6b481-28f4-4ede-a341-77d112d0624c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:44.199474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7fb6b481-28f4-4ede-a341-77d112d0624c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:44.200222 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7fb6b481-28f4-4ede-a341-77d112d0624c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:44.200659 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7fb6b481-28f4-4ede-a341-77d112d0624c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:44.448321 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7fb6b481-28f4-4ede-a341-77d112d0624c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:44.462397 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7fb6b481-28f4-4ede-a341-77d112d0624c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.283553 May 25 17:09:44.463048 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 37/61] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:44 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:44.476258 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c3f2a3c4-fcfd-4cd9-8de5-932d78db8c7e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:44.478224 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c3f2a3c4-fcfd-4cd9-8de5-932d78db8c7e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:44.487052 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c3f2a3c4-fcfd-4cd9-8de5-932d78db8c7e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:44.487751 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c3f2a3c4-fcfd-4cd9-8de5-932d78db8c7e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:44.488747 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c3f2a3c4-fcfd-4cd9-8de5-932d78db8c7e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:44.489323 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c3f2a3c4-fcfd-4cd9-8de5-932d78db8c7e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:44.566217 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c3f2a3c4-fcfd-4cd9-8de5-932d78db8c7e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:44.577121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c3f2a3c4-fcfd-4cd9-8de5-932d78db8c7e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1279 microversion: 2.1 time: 0.112737 May 25 17:09:44.578017 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 38/62] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:44 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:44.583963 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7a17c544-63f5-4441-9af4-ca56dc370c3e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:44.586575 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7a17c544-63f5-4441-9af4-ca56dc370c3e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:44.598403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a17c544-63f5-4441-9af4-ca56dc370c3e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:44.598851 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a17c544-63f5-4441-9af4-ca56dc370c3e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:44.599696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a17c544-63f5-4441-9af4-ca56dc370c3e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:44.600057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a17c544-63f5-4441-9af4-ca56dc370c3e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:44.798187 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7a17c544-63f5-4441-9af4-ca56dc370c3e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:44.808381 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7a17c544-63f5-4441-9af4-ca56dc370c3e tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 0.229043 May 25 17:09:44.809328 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 39/63] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:44 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:44.814290 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d205700b-224a-43b3-a928-0f2f089b3192 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:44.815807 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d205700b-224a-43b3-a928-0f2f089b3192 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:44.822338 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d205700b-224a-43b3-a928-0f2f089b3192 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:44.822983 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d205700b-224a-43b3-a928-0f2f089b3192 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:44.823929 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d205700b-224a-43b3-a928-0f2f089b3192 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:44.824503 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d205700b-224a-43b3-a928-0f2f089b3192 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:44.935031 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d205700b-224a-43b3-a928-0f2f089b3192 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:44.947908 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d205700b-224a-43b3-a928-0f2f089b3192 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:44.951146 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d205700b-224a-43b3-a928-0f2f089b3192 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:44.953062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d205700b-224a-43b3-a928-0f2f089b3192 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1339 microversion: 2.20 time: 0.142009 May 25 17:09:44.954211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 40/64] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:44 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1339 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:45.120501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-b167744c-5d3e-4800-8346-782d57142417 req-cf0e8619-2974-4b6b-9d6d-622378175ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecb9b07-e50d-4926-b95d-af40c6093d83", "tag": "9a8368c6-6150-48dd-9dcf-3a607cd09518"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:45.133553 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-b167744c-5d3e-4800-8346-782d57142417 req-cf0e8619-2974-4b6b-9d6d-622378175ff4 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:45.136960 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-b167744c-5d3e-4800-8346-782d57142417 req-cf0e8619-2974-4b6b-9d6d-622378175ff4 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:45.161324 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-b167744c-5d3e-4800-8346-782d57142417 req-cf0e8619-2974-4b6b-9d6d-622378175ff4 service nova] Creating event network-changed:9a8368c6-6150-48dd-9dcf-3a607cd09518 for instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 on hv-cinder-84330 May 25 17:09:45.181206 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-b167744c-5d3e-4800-8346-782d57142417 req-cf0e8619-2974-4b6b-9d6d-622378175ff4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063041 May 25 17:09:45.181900 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 41/65] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:09:45.291619 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:09:45.292123 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:09:45.292494 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:09:45.292921 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:09:45.293504 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:09:45.309945 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:45.310593 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:45.311561 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:45.312158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:45.351134 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:09:45.360073 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for user 3fb5eecf3e244058905ea3aba8112320 and project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:09:45.384977 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:09:45.390539 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:09:45.480047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-537b698b-829e-4e4c-bbe9-193b818a4f26 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:45.481492 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-537b698b-829e-4e4c-bbe9-193b818a4f26 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:45.497212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-537b698b-829e-4e4c-bbe9-193b818a4f26 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:45.506184 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-537b698b-829e-4e4c-bbe9-193b818a4f26 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:45.507798 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-537b698b-829e-4e4c-bbe9-193b818a4f26 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:45.509155 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-537b698b-829e-4e4c-bbe9-193b818a4f26 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:45.546353 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-76d28f15-589f-4931-960d-b6edebd4a367 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.122161 May 25 17:09:45.547653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 25/66] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:09:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:09:45.561080 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-91e3f382-69b2-49db-811d-d588b06f8131 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:45.562764 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-91e3f382-69b2-49db-811d-d588b06f8131 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:45.752481 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-91e3f382-69b2-49db-811d-d588b06f8131 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:45.766272 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-91e3f382-69b2-49db-811d-d588b06f8131 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1241 microversion: 2.1 time: 0.211793 May 25 17:09:45.767450 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 26/67] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:45 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1241 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:45.773750 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-83ae0366-58c1-4644-b198-2168d15e153e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:45.774536 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-83ae0366-58c1-4644-b198-2168d15e153e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:45.787079 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83ae0366-58c1-4644-b198-2168d15e153e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:45.787925 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83ae0366-58c1-4644-b198-2168d15e153e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:45.789129 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83ae0366-58c1-4644-b198-2168d15e153e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:45.789830 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83ae0366-58c1-4644-b198-2168d15e153e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:46.456632 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-537b698b-829e-4e4c-bbe9-193b818a4f26 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:46.465631 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-537b698b-829e-4e4c-bbe9-193b818a4f26 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.989896 May 25 17:09:46.469261 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 42/68] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:45 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:46.481653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-23f08aac-b066-4997-ab76-a40b48fd3a63 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:46.483042 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-23f08aac-b066-4997-ab76-a40b48fd3a63 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:46.497505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-23f08aac-b066-4997-ab76-a40b48fd3a63 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:46.497967 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-23f08aac-b066-4997-ab76-a40b48fd3a63 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:46.499223 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-23f08aac-b066-4997-ab76-a40b48fd3a63 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:46.499668 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-23f08aac-b066-4997-ab76-a40b48fd3a63 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:46.807850 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-23f08aac-b066-4997-ab76-a40b48fd3a63 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:46.822893 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-23f08aac-b066-4997-ab76-a40b48fd3a63 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 0.352268 May 25 17:09:46.823521 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 43/69] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:46 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:46.839831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1aa41c3c-ee29-45de-acbf-132ef51651b5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:46.841712 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1aa41c3c-ee29-45de-acbf-132ef51651b5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:46.863395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1aa41c3c-ee29-45de-acbf-132ef51651b5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:46.863908 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1aa41c3c-ee29-45de-acbf-132ef51651b5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:46.866757 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1aa41c3c-ee29-45de-acbf-132ef51651b5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:46.867400 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1aa41c3c-ee29-45de-acbf-132ef51651b5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:47.011326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1aa41c3c-ee29-45de-acbf-132ef51651b5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:47.014697 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-83ae0366-58c1-4644-b198-2168d15e153e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:47.025415 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-83ae0366-58c1-4644-b198-2168d15e153e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 1.255886 May 25 17:09:47.027002 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 27/70] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:45 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:47.031145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1aa41c3c-ee29-45de-acbf-132ef51651b5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:47.032715 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1aa41c3c-ee29-45de-acbf-132ef51651b5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:47.042814 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1aa41c3c-ee29-45de-acbf-132ef51651b5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1339 microversion: 2.20 time: 0.218224 May 25 17:09:47.046720 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 44/71] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:46 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1339 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:47.058632 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1d7f981f-032b-4900-af2f-c11a351aa6c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:47.059263 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1d7f981f-032b-4900-af2f-c11a351aa6c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:47.092771 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1d7f981f-032b-4900-af2f-c11a351aa6c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:47.094686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1d7f981f-032b-4900-af2f-c11a351aa6c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:47.096360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1d7f981f-032b-4900-af2f-c11a351aa6c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:47.098080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1d7f981f-032b-4900-af2f-c11a351aa6c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:47.162164 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-62301e2a-6f26-440e-9464-3b5df986a56d req-918094fe-b290-4295-b117-a30a9b44abc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a815e8-f0d5-4121-9124-d96e02afa8b2", "name": "network-vif-plugged", "status": "completed", "tag": "adbfec7d-46e1-477d-8236-36f39e8d299f"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:47.183376 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-62301e2a-6f26-440e-9464-3b5df986a56d req-918094fe-b290-4295-b117-a30a9b44abc9 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:47.185118 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-62301e2a-6f26-440e-9464-3b5df986a56d req-918094fe-b290-4295-b117-a30a9b44abc9 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:47.230329 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1d7f981f-032b-4900-af2f-c11a351aa6c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:47.234226 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-62301e2a-6f26-440e-9464-3b5df986a56d req-918094fe-b290-4295-b117-a30a9b44abc9 service nova] Creating event network-vif-plugged:adbfec7d-46e1-477d-8236-36f39e8d299f for instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 on hv-cinder-84330 May 25 17:09:47.237485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-62301e2a-6f26-440e-9464-3b5df986a56d req-918094fe-b290-4295-b117-a30a9b44abc9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 17:09:47.240176 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4814cc6c-ee4c-472e-b453-0a5384fa5c85 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:47.241697 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4814cc6c-ee4c-472e-b453-0a5384fa5c85 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:47.242543 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4814cc6c-ee4c-472e-b453-0a5384fa5c85 None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:47.242988 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4814cc6c-ee4c-472e-b453-0a5384fa5c85 None None] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:47.245788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1d7f981f-032b-4900-af2f-c11a351aa6c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1311 microversion: 2.1 time: 0.195066 May 25 17:09:47.258610 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 45/72] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:47 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:47.275047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.compute.rpcapi [None req-4814cc6c-ee4c-472e-b453-0a5384fa5c85 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 17:09:47.275968 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4814cc6c-ee4c-472e-b453-0a5384fa5c85 None None] Releasing lock "compute-rpcapi-router" {{(pid=117696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 17:09:47.310992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4814cc6c-ee4c-472e-b453-0a5384fa5c85 None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281693 May 25 17:09:47.311633 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 28/73] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:47.485306 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0856f92b-47ca-421d-bc90-17788ca57294 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:47.487205 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0856f92b-47ca-421d-bc90-17788ca57294 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:47.493954 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0856f92b-47ca-421d-bc90-17788ca57294 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:47.494674 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0856f92b-47ca-421d-bc90-17788ca57294 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:47.495592 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0856f92b-47ca-421d-bc90-17788ca57294 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:47.496085 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0856f92b-47ca-421d-bc90-17788ca57294 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:47.634979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0856f92b-47ca-421d-bc90-17788ca57294 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:47.642563 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0856f92b-47ca-421d-bc90-17788ca57294 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.161093 May 25 17:09:47.643173 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 46/74] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:47 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:47.840764 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e050fbdf-9279-4400-9764-732edb29688f tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:47.841833 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e050fbdf-9279-4400-9764-732edb29688f tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:47.860498 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e050fbdf-9279-4400-9764-732edb29688f tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:47.862299 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e050fbdf-9279-4400-9764-732edb29688f tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:47.865093 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e050fbdf-9279-4400-9764-732edb29688f tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:47.866518 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e050fbdf-9279-4400-9764-732edb29688f tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:48.044397 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1c07b1a5-6037-41d5-aa09-c55d4ade1bc4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:48.045609 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1c07b1a5-6037-41d5-aa09-c55d4ade1bc4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:48.050417 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=6 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:48.077522 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c07b1a5-6037-41d5-aa09-c55d4ade1bc4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:48.083167 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c07b1a5-6037-41d5-aa09-c55d4ade1bc4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:48.085621 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c07b1a5-6037-41d5-aa09-c55d4ade1bc4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:48.087592 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c07b1a5-6037-41d5-aa09-c55d4ade1bc4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:48.386909 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=22 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:48.586433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e050fbdf-9279-4400-9764-732edb29688f tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:48.619486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e050fbdf-9279-4400-9764-732edb29688f tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 0.782913 May 25 17:09:48.623307 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 29/75] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:47 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:48.630436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d20a4516-69bd-4041-9e49-5769ef34dbc6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:48.631487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d20a4516-69bd-4041-9e49-5769ef34dbc6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:48.644358 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d20a4516-69bd-4041-9e49-5769ef34dbc6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:48.646040 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d20a4516-69bd-4041-9e49-5769ef34dbc6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:48.647496 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d20a4516-69bd-4041-9e49-5769ef34dbc6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:48.649761 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d20a4516-69bd-4041-9e49-5769ef34dbc6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:48.771381 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1c07b1a5-6037-41d5-aa09-c55d4ade1bc4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:48.783210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1c07b1a5-6037-41d5-aa09-c55d4ade1bc4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.743720 May 25 17:09:48.783852 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 47/76] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:48 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:48.796412 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-85b66b68-12ab-4b0a-ad9b-7af58b3e7517 req-37f9a312-c4ff-49c4-bfcb-eea3e83454b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "255e860e-8389-4f93-b7d0-2d80d7b7ad7d", "tag": "4708bad2-cbd1-44cd-9155-df4a2de8c416"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:48.815081 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-85b66b68-12ab-4b0a-ad9b-7af58b3e7517 req-37f9a312-c4ff-49c4-bfcb-eea3e83454b4 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:48.815684 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-85b66b68-12ab-4b0a-ad9b-7af58b3e7517 req-37f9a312-c4ff-49c4-bfcb-eea3e83454b4 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:48.840283 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-85b66b68-12ab-4b0a-ad9b-7af58b3e7517 req-37f9a312-c4ff-49c4-bfcb-eea3e83454b4 service nova] Creating event network-changed:4708bad2-cbd1-44cd-9155-df4a2de8c416 for instance 255e860e-8389-4f93-b7d0-2d80d7b7ad7d on hv-cinder-84330 May 25 17:09:48.858440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-85b66b68-12ab-4b0a-ad9b-7af58b3e7517 req-37f9a312-c4ff-49c4-bfcb-eea3e83454b4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065637 May 25 17:09:48.859049 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 48/77] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:48.864373 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a8f4f9a2-ef62-409c-a41a-c207b50c87ef tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:48.865104 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a8f4f9a2-ef62-409c-a41a-c207b50c87ef tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:48.871652 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a8f4f9a2-ef62-409c-a41a-c207b50c87ef tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:48.872107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a8f4f9a2-ef62-409c-a41a-c207b50c87ef tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:48.872951 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a8f4f9a2-ef62-409c-a41a-c207b50c87ef tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:48.873716 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a8f4f9a2-ef62-409c-a41a-c207b50c87ef tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:48.901919 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d20a4516-69bd-4041-9e49-5769ef34dbc6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:48.913548 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d20a4516-69bd-4041-9e49-5769ef34dbc6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:48.915337 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d20a4516-69bd-4041-9e49-5769ef34dbc6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:48.916651 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d20a4516-69bd-4041-9e49-5769ef34dbc6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1339 microversion: 2.20 time: 0.291845 May 25 17:09:48.917516 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 30/78] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:48 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1339 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:48.924083 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c438e7c2-e48e-4bff-be54-fc7eabf5219d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:48.925230 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c438e7c2-e48e-4bff-be54-fc7eabf5219d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:48.934426 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c438e7c2-e48e-4bff-be54-fc7eabf5219d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:48.934892 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c438e7c2-e48e-4bff-be54-fc7eabf5219d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:48.935648 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c438e7c2-e48e-4bff-be54-fc7eabf5219d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:48.936088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c438e7c2-e48e-4bff-be54-fc7eabf5219d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:49.052064 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a8f4f9a2-ef62-409c-a41a-c207b50c87ef tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:49.059857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a8f4f9a2-ef62-409c-a41a-c207b50c87ef tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1299 microversion: 2.1 time: 0.199627 May 25 17:09:49.060780 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 49/79] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:48 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:49.350305 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c438e7c2-e48e-4bff-be54-fc7eabf5219d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:49.363611 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c438e7c2-e48e-4bff-be54-fc7eabf5219d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.444746 May 25 17:09:49.372728 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 31/80] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:48 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:49.642521 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-424c7ccc-67d1-4f53-b7bc-366023ae9dad tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:49.643733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-424c7ccc-67d1-4f53-b7bc-366023ae9dad tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:49.660105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-424c7ccc-67d1-4f53-b7bc-366023ae9dad tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:49.660710 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-424c7ccc-67d1-4f53-b7bc-366023ae9dad tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:49.661852 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-424c7ccc-67d1-4f53-b7bc-366023ae9dad tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:49.662336 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-424c7ccc-67d1-4f53-b7bc-366023ae9dad tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:49.818399 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-546ab859-eae0-4df4-bd21-b34c37397fe0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:49.822146 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-546ab859-eae0-4df4-bd21-b34c37397fe0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:49.840075 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-546ab859-eae0-4df4-bd21-b34c37397fe0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:49.841913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-546ab859-eae0-4df4-bd21-b34c37397fe0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:49.843339 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-546ab859-eae0-4df4-bd21-b34c37397fe0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:49.845094 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-546ab859-eae0-4df4-bd21-b34c37397fe0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:50.170121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-424c7ccc-67d1-4f53-b7bc-366023ae9dad tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:50.180224 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-424c7ccc-67d1-4f53-b7bc-366023ae9dad tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1315 microversion: 2.1 time: 0.541612 May 25 17:09:50.181246 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 50/81] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:49 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:50.186668 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5b339867-2580-4e35-b44b-2a5ede14cf53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:50.187664 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5b339867-2580-4e35-b44b-2a5ede14cf53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:50.201389 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5b339867-2580-4e35-b44b-2a5ede14cf53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:50.201834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5b339867-2580-4e35-b44b-2a5ede14cf53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:50.202766 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5b339867-2580-4e35-b44b-2a5ede14cf53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:50.203039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5b339867-2580-4e35-b44b-2a5ede14cf53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:50.474471 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5b339867-2580-4e35-b44b-2a5ede14cf53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:50.483364 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5b339867-2580-4e35-b44b-2a5ede14cf53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:50.485210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5b339867-2580-4e35-b44b-2a5ede14cf53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:50.486543 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5b339867-2580-4e35-b44b-2a5ede14cf53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.304107 May 25 17:09:50.487303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 51/82] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:50 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:50.493605 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-babe7c36-0b03-4c62-9c3e-3917bc8f566c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:50.494679 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-babe7c36-0b03-4c62-9c3e-3917bc8f566c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:50.507316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-babe7c36-0b03-4c62-9c3e-3917bc8f566c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:50.508258 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-babe7c36-0b03-4c62-9c3e-3917bc8f566c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:50.509534 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-babe7c36-0b03-4c62-9c3e-3917bc8f566c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:50.510177 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-babe7c36-0b03-4c62-9c3e-3917bc8f566c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:50.641067 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-546ab859-eae0-4df4-bd21-b34c37397fe0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:50.661741 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-546ab859-eae0-4df4-bd21-b34c37397fe0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.857632 May 25 17:09:50.673290 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 32/83] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:49 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:50.681232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f930dca9-6519-44d4-a431-7098393be889 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:50.683482 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f930dca9-6519-44d4-a431-7098393be889 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:50.694253 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f930dca9-6519-44d4-a431-7098393be889 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:50.695012 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f930dca9-6519-44d4-a431-7098393be889 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:50.697290 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f930dca9-6519-44d4-a431-7098393be889 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:50.698993 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f930dca9-6519-44d4-a431-7098393be889 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:50.753678 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-babe7c36-0b03-4c62-9c3e-3917bc8f566c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:50.772048 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-babe7c36-0b03-4c62-9c3e-3917bc8f566c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.283205 May 25 17:09:50.772650 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 52/84] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:50 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:51.026078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-57ebd57a-5fa3-41e9-9317-5f715a0be330 req-834699be-0a6f-4fb9-bd0e-003e34b8987f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4176ef9b-9601-4e3d-bc52-51854be03fd7", "tag": "fb7d08f7-f9a7-41b7-9a81-da056a75e0de"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:51.069510 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-57ebd57a-5fa3-41e9-9317-5f715a0be330 req-834699be-0a6f-4fb9-bd0e-003e34b8987f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:51.073005 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-57ebd57a-5fa3-41e9-9317-5f715a0be330 req-834699be-0a6f-4fb9-bd0e-003e34b8987f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:51.097811 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-57ebd57a-5fa3-41e9-9317-5f715a0be330 req-834699be-0a6f-4fb9-bd0e-003e34b8987f service nova] Creating event network-changed:fb7d08f7-f9a7-41b7-9a81-da056a75e0de for instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 on hv-cinder-84330 May 25 17:09:51.105191 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-57ebd57a-5fa3-41e9-9317-5f715a0be330 req-834699be-0a6f-4fb9-bd0e-003e34b8987f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083587 May 25 17:09:51.106325 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 53/85] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:51.199245 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-db6d611f-921b-414c-87de-7d093ecf4e15 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:51.200032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-db6d611f-921b-414c-87de-7d093ecf4e15 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:51.209510 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-db6d611f-921b-414c-87de-7d093ecf4e15 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:51.210032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-db6d611f-921b-414c-87de-7d093ecf4e15 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:51.211428 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-db6d611f-921b-414c-87de-7d093ecf4e15 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:51.211867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-db6d611f-921b-414c-87de-7d093ecf4e15 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:51.321480 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f930dca9-6519-44d4-a431-7098393be889 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:51.328605 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f930dca9-6519-44d4-a431-7098393be889 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.653830 May 25 17:09:51.346724 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 33/86] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:50 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:51.450881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-db6d611f-921b-414c-87de-7d093ecf4e15 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:51.459268 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-db6d611f-921b-414c-87de-7d093ecf4e15 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1500 microversion: 2.1 time: 0.265259 May 25 17:09:51.459859 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 54/87] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:51 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1500 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:51.510760 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f942d650-db5f-4111-84ad-aabb2544357b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:51.511822 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f942d650-db5f-4111-84ad-aabb2544357b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:51.530092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f942d650-db5f-4111-84ad-aabb2544357b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:51.530543 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f942d650-db5f-4111-84ad-aabb2544357b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:51.531311 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f942d650-db5f-4111-84ad-aabb2544357b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:51.531742 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f942d650-db5f-4111-84ad-aabb2544357b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:51.681124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-927a1bc2-98bd-4a64-b092-03c5ccc69437 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:51.682242 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-927a1bc2-98bd-4a64-b092-03c5ccc69437 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:51.703367 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-927a1bc2-98bd-4a64-b092-03c5ccc69437 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:51.706852 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-927a1bc2-98bd-4a64-b092-03c5ccc69437 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:51.708003 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-927a1bc2-98bd-4a64-b092-03c5ccc69437 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:51.708877 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-927a1bc2-98bd-4a64-b092-03c5ccc69437 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:51.803987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=100 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:52.140137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f942d650-db5f-4111-84ad-aabb2544357b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:52.155893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f942d650-db5f-4111-84ad-aabb2544357b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:52.157783 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f942d650-db5f-4111-84ad-aabb2544357b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:52.161463 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f942d650-db5f-4111-84ad-aabb2544357b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.658633 May 25 17:09:52.173131 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 34/88] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:51 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:52.180440 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-61fd446c-2cce-4f28-ab2f-f9f51fedcd75 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:52.181670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-61fd446c-2cce-4f28-ab2f-f9f51fedcd75 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:52.217884 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61fd446c-2cce-4f28-ab2f-f9f51fedcd75 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:52.218360 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61fd446c-2cce-4f28-ab2f-f9f51fedcd75 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:52.219183 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61fd446c-2cce-4f28-ab2f-f9f51fedcd75 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:52.219804 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61fd446c-2cce-4f28-ab2f-f9f51fedcd75 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:52.336011 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-927a1bc2-98bd-4a64-b092-03c5ccc69437 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:52.344891 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-927a1bc2-98bd-4a64-b092-03c5ccc69437 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.669942 May 25 17:09:52.348626 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 55/89] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:51 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:52.364419 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8289cac8-1bac-4663-8335-a155c2a8a719 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:52.365250 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8289cac8-1bac-4663-8335-a155c2a8a719 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:52.378593 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8289cac8-1bac-4663-8335-a155c2a8a719 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:52.384029 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8289cac8-1bac-4663-8335-a155c2a8a719 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:52.385126 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8289cac8-1bac-4663-8335-a155c2a8a719 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:52.385678 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8289cac8-1bac-4663-8335-a155c2a8a719 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:52.690799 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-61fd446c-2cce-4f28-ab2f-f9f51fedcd75 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:52.701610 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-61fd446c-2cce-4f28-ab2f-f9f51fedcd75 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.525937 May 25 17:09:52.714652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 35/90] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:52 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:52.722533 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-aa75716e-f35a-4a41-a081-ce4807f6d769 req-f5b92147-073f-45c1-adaa-15b4fef2365c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f434295-7a0d-4d51-8f4e-6698b399b20a", "name": "network-vif-plugged", "status": "completed", "tag": "3c00686d-3bd0-4e09-a004-2c18e278c159"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:52.734928 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-aa75716e-f35a-4a41-a081-ce4807f6d769 req-f5b92147-073f-45c1-adaa-15b4fef2365c service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:52.735589 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-aa75716e-f35a-4a41-a081-ce4807f6d769 req-f5b92147-073f-45c1-adaa-15b4fef2365c service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:52.758782 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-aa75716e-f35a-4a41-a081-ce4807f6d769 req-f5b92147-073f-45c1-adaa-15b4fef2365c service nova] Creating event network-vif-plugged:3c00686d-3bd0-4e09-a004-2c18e278c159 for instance 8f434295-7a0d-4d51-8f4e-6698b399b20a on hv-cinder-84330 May 25 17:09:52.768968 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-aa75716e-f35a-4a41-a081-ce4807f6d769 req-f5b92147-073f-45c1-adaa-15b4fef2365c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052009 May 25 17:09:52.769911 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 36/91] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:52.899877 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8289cac8-1bac-4663-8335-a155c2a8a719 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:52.917075 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8289cac8-1bac-4663-8335-a155c2a8a719 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.560083 May 25 17:09:52.926843 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 56/92] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:52 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:52.945276 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-4ec3ac33-ec34-4475-942c-dc69b231567a req-8f9082ee-d747-4401-9dea-389c4be5bbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99e2d9c-ac45-4a8e-8076-faaf830c29e0", "tag": "fa9d31d9-985b-4772-a564-1cbeee313f84"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:52.964785 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4ec3ac33-ec34-4475-942c-dc69b231567a req-8f9082ee-d747-4401-9dea-389c4be5bbb2 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:52.973560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4ec3ac33-ec34-4475-942c-dc69b231567a req-8f9082ee-d747-4401-9dea-389c4be5bbb2 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:53.004931 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-4ec3ac33-ec34-4475-942c-dc69b231567a req-8f9082ee-d747-4401-9dea-389c4be5bbb2 service nova] Creating event network-changed:fa9d31d9-985b-4772-a564-1cbeee313f84 for instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 on hv-cinder-84330 May 25 17:09:53.011400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-4ec3ac33-ec34-4475-942c-dc69b231567a req-8f9082ee-d747-4401-9dea-389c4be5bbb2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071375 May 25 17:09:53.012466 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 37/93] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:09:53.180343 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c8ab5909-0dd9-41e2-bfd1-c331f94fba6a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:53.181141 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c8ab5909-0dd9-41e2-bfd1-c331f94fba6a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:53.187882 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c8ab5909-0dd9-41e2-bfd1-c331f94fba6a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:53.192871 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c8ab5909-0dd9-41e2-bfd1-c331f94fba6a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:53.193835 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c8ab5909-0dd9-41e2-bfd1-c331f94fba6a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:53.194431 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c8ab5909-0dd9-41e2-bfd1-c331f94fba6a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:53.342897 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2f7928b6-8722-4461-8087-6c88d6141942 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dca2e12-a500-4de7-a163-79858ce8c7fe"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:53.344213 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2f7928b6-8722-4461-8087-6c88d6141942 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:53.357539 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f7928b6-8722-4461-8087-6c88d6141942 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:53.360659 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f7928b6-8722-4461-8087-6c88d6141942 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:53.362212 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f7928b6-8722-4461-8087-6c88d6141942 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:53.362655 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f7928b6-8722-4461-8087-6c88d6141942 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:53.559029 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:53.756718 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c8ab5909-0dd9-41e2-bfd1-c331f94fba6a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:53.766813 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c8ab5909-0dd9-41e2-bfd1-c331f94fba6a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:53.768898 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c8ab5909-0dd9-41e2-bfd1-c331f94fba6a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:53.770026 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c8ab5909-0dd9-41e2-bfd1-c331f94fba6a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.594166 May 25 17:09:53.781204 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 57/94] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:53 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:53.791942 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-12dbd7d1-c1d9-4556-8aa8-5fda15d50ba3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:53.794486 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-12dbd7d1-c1d9-4556-8aa8-5fda15d50ba3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:53.816018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-12dbd7d1-c1d9-4556-8aa8-5fda15d50ba3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:53.818148 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-12dbd7d1-c1d9-4556-8aa8-5fda15d50ba3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:53.819094 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-12dbd7d1-c1d9-4556-8aa8-5fda15d50ba3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:53.821763 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-12dbd7d1-c1d9-4556-8aa8-5fda15d50ba3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:54.015932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2f7928b6-8722-4461-8087-6c88d6141942 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "POST /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.677689 May 25 17:09:54.023686 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 38/95] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:09:53 2022] POST /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:09:54.031863 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6c941121-53a6-4a50-a659-be24205d85f0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:54.035734 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6c941121-53a6-4a50-a659-be24205d85f0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:54.052273 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c941121-53a6-4a50-a659-be24205d85f0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:54.053801 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c941121-53a6-4a50-a659-be24205d85f0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:54.056357 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c941121-53a6-4a50-a659-be24205d85f0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:54.057058 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c941121-53a6-4a50-a659-be24205d85f0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:54.128245 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-12dbd7d1-c1d9-4556-8aa8-5fda15d50ba3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:54.141485 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-12dbd7d1-c1d9-4556-8aa8-5fda15d50ba3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.354040 May 25 17:09:54.142694 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 58/96] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:53 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:54.149132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-88609199-a471-48bd-9738-4370da1f4c61 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:54.150667 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-88609199-a471-48bd-9738-4370da1f4c61 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:54.178833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-88609199-a471-48bd-9738-4370da1f4c61 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:54.181144 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-88609199-a471-48bd-9738-4370da1f4c61 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:54.182874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-88609199-a471-48bd-9738-4370da1f4c61 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:54.187748 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-88609199-a471-48bd-9738-4370da1f4c61 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:54.284443 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6c941121-53a6-4a50-a659-be24205d85f0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:54.292809 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6c941121-53a6-4a50-a659-be24205d85f0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.268114 May 25 17:09:54.293398 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 39/97] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:54 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:54.373137 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-88609199-a471-48bd-9738-4370da1f4c61 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:54.382370 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-88609199-a471-48bd-9738-4370da1f4c61 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.238615 May 25 17:09:54.383117 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 59/98] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:54 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:54.790540 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-93e421c4-ec08-420c-abfd-1c367054f841 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:54.791612 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-93e421c4-ec08-420c-abfd-1c367054f841 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:54.799659 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93e421c4-ec08-420c-abfd-1c367054f841 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:54.800634 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93e421c4-ec08-420c-abfd-1c367054f841 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:54.801749 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93e421c4-ec08-420c-abfd-1c367054f841 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:54.802741 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93e421c4-ec08-420c-abfd-1c367054f841 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:54.815601 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-b3e6074a-bbfd-44b0-a141-5a6c890b9a87 req-99e0d5f0-eb89-41f8-9fd8-a0adfda9d18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecb9b07-e50d-4926-b95d-af40c6093d83", "name": "network-vif-plugged", "status": "completed", "tag": "9a8368c6-6150-48dd-9dcf-3a607cd09518"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:54.828110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-b3e6074a-bbfd-44b0-a141-5a6c890b9a87 req-99e0d5f0-eb89-41f8-9fd8-a0adfda9d18d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:54.828658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-b3e6074a-bbfd-44b0-a141-5a6c890b9a87 req-99e0d5f0-eb89-41f8-9fd8-a0adfda9d18d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:54.849854 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-b3e6074a-bbfd-44b0-a141-5a6c890b9a87 req-99e0d5f0-eb89-41f8-9fd8-a0adfda9d18d service nova] Creating event network-vif-plugged:9a8368c6-6150-48dd-9dcf-3a607cd09518 for instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 on hv-cinder-84330 May 25 17:09:54.857788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-b3e6074a-bbfd-44b0-a141-5a6c890b9a87 req-99e0d5f0-eb89-41f8-9fd8-a0adfda9d18d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047165 May 25 17:09:54.858565 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 60/99] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:09:55.123044 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-93e421c4-ec08-420c-abfd-1c367054f841 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:55.132929 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-93e421c4-ec08-420c-abfd-1c367054f841 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:55.134439 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-93e421c4-ec08-420c-abfd-1c367054f841 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:55.135555 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-93e421c4-ec08-420c-abfd-1c367054f841 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.349503 May 25 17:09:55.136117 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 40/100] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:54 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:55.180325 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6a215f3f-3f70-4d50-a137-e0069e88309d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:55.181498 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6a215f3f-3f70-4d50-a137-e0069e88309d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:55.188054 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6a215f3f-3f70-4d50-a137-e0069e88309d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:55.188705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6a215f3f-3f70-4d50-a137-e0069e88309d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:55.190882 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6a215f3f-3f70-4d50-a137-e0069e88309d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:55.191555 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6a215f3f-3f70-4d50-a137-e0069e88309d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:55.312006 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5a30772e-5fb0-47f8-9dd2-03f01377409d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:55.313075 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5a30772e-5fb0-47f8-9dd2-03f01377409d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:55.320480 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5a30772e-5fb0-47f8-9dd2-03f01377409d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:55.321195 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5a30772e-5fb0-47f8-9dd2-03f01377409d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:55.321968 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5a30772e-5fb0-47f8-9dd2-03f01377409d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:55.322588 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5a30772e-5fb0-47f8-9dd2-03f01377409d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:55.343017 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6a215f3f-3f70-4d50-a137-e0069e88309d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:55.352789 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6a215f3f-3f70-4d50-a137-e0069e88309d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.176664 May 25 17:09:55.354175 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 61/101] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:55 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:55.402623 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-527060c8-16b9-41bd-bd0b-18f5def08e01 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:55.403641 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-527060c8-16b9-41bd-bd0b-18f5def08e01 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:55.418306 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-527060c8-16b9-41bd-bd0b-18f5def08e01 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:55.419373 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-527060c8-16b9-41bd-bd0b-18f5def08e01 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:55.421142 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-527060c8-16b9-41bd-bd0b-18f5def08e01 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:55.422046 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-527060c8-16b9-41bd-bd0b-18f5def08e01 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:55.493211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5a30772e-5fb0-47f8-9dd2-03f01377409d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:55.502389 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5a30772e-5fb0-47f8-9dd2-03f01377409d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.195427 May 25 17:09:55.503817 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 41/102] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:55 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:55.576803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-527060c8-16b9-41bd-bd0b-18f5def08e01 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:55.586034 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-527060c8-16b9-41bd-bd0b-18f5def08e01 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.189585 May 25 17:09:55.586797 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 62/103] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:55 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:56.154402 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9ffbad3f-87d8-4285-bbbe-5b874b3321e4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:56.155113 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9ffbad3f-87d8-4285-bbbe-5b874b3321e4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:56.157064 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=13 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:56.163840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ffbad3f-87d8-4285-bbbe-5b874b3321e4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:56.164288 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ffbad3f-87d8-4285-bbbe-5b874b3321e4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:56.165089 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ffbad3f-87d8-4285-bbbe-5b874b3321e4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:56.165679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ffbad3f-87d8-4285-bbbe-5b874b3321e4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:56.343859 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9ffbad3f-87d8-4285-bbbe-5b874b3321e4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:56.352275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9ffbad3f-87d8-4285-bbbe-5b874b3321e4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:56.353843 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9ffbad3f-87d8-4285-bbbe-5b874b3321e4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:56.354973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9ffbad3f-87d8-4285-bbbe-5b874b3321e4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.204683 May 25 17:09:56.365713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 42/104] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:56 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:56.372036 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0f15a790-2d5f-45a8-87a9-5b26d612b05d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:56.372745 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0f15a790-2d5f-45a8-87a9-5b26d612b05d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:56.379524 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0f15a790-2d5f-45a8-87a9-5b26d612b05d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:56.379970 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0f15a790-2d5f-45a8-87a9-5b26d612b05d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:56.380751 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0f15a790-2d5f-45a8-87a9-5b26d612b05d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:56.381183 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0f15a790-2d5f-45a8-87a9-5b26d612b05d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:56.522950 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-721f1aa4-396f-4d3d-a54f-138ea42b44cc tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:56.523904 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-721f1aa4-396f-4d3d-a54f-138ea42b44cc tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:56.537452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-721f1aa4-396f-4d3d-a54f-138ea42b44cc tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:56.537916 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-721f1aa4-396f-4d3d-a54f-138ea42b44cc tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:56.538725 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-721f1aa4-396f-4d3d-a54f-138ea42b44cc tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:56.539169 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-721f1aa4-396f-4d3d-a54f-138ea42b44cc tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:56.690816 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0f15a790-2d5f-45a8-87a9-5b26d612b05d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:56.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0f15a790-2d5f-45a8-87a9-5b26d612b05d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.333483 May 25 17:09:56.701667 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 63/105] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:56 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:56.707581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d98fd0da-af20-4e90-a9c5-ec60451794bd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:56.708582 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d98fd0da-af20-4e90-a9c5-ec60451794bd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:56.715064 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d98fd0da-af20-4e90-a9c5-ec60451794bd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:56.715803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d98fd0da-af20-4e90-a9c5-ec60451794bd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:56.716645 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d98fd0da-af20-4e90-a9c5-ec60451794bd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:56.717294 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d98fd0da-af20-4e90-a9c5-ec60451794bd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:56.991541 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d98fd0da-af20-4e90-a9c5-ec60451794bd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:57.000639 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d98fd0da-af20-4e90-a9c5-ec60451794bd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.297526 May 25 17:09:57.001473 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 64/106] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:56 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:57.009092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-721f1aa4-396f-4d3d-a54f-138ea42b44cc tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:57.018178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-721f1aa4-396f-4d3d-a54f-138ea42b44cc tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.498338 May 25 17:09:57.021586 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 43/107] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:56 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:57.373651 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-915e1efa-ed73-45f0-ba10-bc803ec3d5c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:57.374343 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-915e1efa-ed73-45f0-ba10-bc803ec3d5c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:57.381708 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-915e1efa-ed73-45f0-ba10-bc803ec3d5c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:57.382453 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-915e1efa-ed73-45f0-ba10-bc803ec3d5c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:57.383549 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-915e1efa-ed73-45f0-ba10-bc803ec3d5c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:57.384453 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-915e1efa-ed73-45f0-ba10-bc803ec3d5c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:57.532348 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-915e1efa-ed73-45f0-ba10-bc803ec3d5c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:57.541160 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-915e1efa-ed73-45f0-ba10-bc803ec3d5c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:57.542675 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-915e1efa-ed73-45f0-ba10-bc803ec3d5c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:57.543787 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-915e1efa-ed73-45f0-ba10-bc803ec3d5c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.174776 May 25 17:09:57.544351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 65/108] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:57 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:57.723771 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1d4c738a-320c-4643-925c-255dbaf9f2ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:57.724535 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1d4c738a-320c-4643-925c-255dbaf9f2ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:57.727860 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=8 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:57.731588 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1d4c738a-320c-4643-925c-255dbaf9f2ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:57.732039 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1d4c738a-320c-4643-925c-255dbaf9f2ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:57.732850 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1d4c738a-320c-4643-925c-255dbaf9f2ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:57.733627 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1d4c738a-320c-4643-925c-255dbaf9f2ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:57.865566 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1d4c738a-320c-4643-925c-255dbaf9f2ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:57.872971 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1d4c738a-320c-4643-925c-255dbaf9f2ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.154498 May 25 17:09:57.873629 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 44/109] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:57 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:58.018301 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c0f50706-9193-4dc7-9cbe-23487234267c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:58.019006 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c0f50706-9193-4dc7-9cbe-23487234267c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:58.020953 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:58.026669 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c0f50706-9193-4dc7-9cbe-23487234267c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:58.027112 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c0f50706-9193-4dc7-9cbe-23487234267c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:58.027861 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c0f50706-9193-4dc7-9cbe-23487234267c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:58.028295 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c0f50706-9193-4dc7-9cbe-23487234267c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:58.034985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bcea93ea-d8d2-456e-b614-1abcd0e73283 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:58.035700 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bcea93ea-d8d2-456e-b614-1abcd0e73283 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:58.041769 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bcea93ea-d8d2-456e-b614-1abcd0e73283 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:58.042219 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bcea93ea-d8d2-456e-b614-1abcd0e73283 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:58.043016 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bcea93ea-d8d2-456e-b614-1abcd0e73283 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:58.043453 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bcea93ea-d8d2-456e-b614-1abcd0e73283 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:58.199626 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bcea93ea-d8d2-456e-b614-1abcd0e73283 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:58.208521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bcea93ea-d8d2-456e-b614-1abcd0e73283 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.177573 May 25 17:09:58.209138 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 45/110] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:58 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:58.253757 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c0f50706-9193-4dc7-9cbe-23487234267c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:58.262361 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c0f50706-9193-4dc7-9cbe-23487234267c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.248410 May 25 17:09:58.262954 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 66/111] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:58 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:58.448439 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-9a39340f-d2a8-4a45-bd37-7595f3e98f77 req-e23a1ee3-d21c-4903-b2bb-e03bdb10b384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255e860e-8389-4f93-b7d0-2d80d7b7ad7d", "name": "network-vif-plugged", "status": "completed", "tag": "4708bad2-cbd1-44cd-9155-df4a2de8c416"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:09:58.462577 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-9a39340f-d2a8-4a45-bd37-7595f3e98f77 req-e23a1ee3-d21c-4903-b2bb-e03bdb10b384 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:58.463096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-9a39340f-d2a8-4a45-bd37-7595f3e98f77 req-e23a1ee3-d21c-4903-b2bb-e03bdb10b384 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:58.479187 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-9a39340f-d2a8-4a45-bd37-7595f3e98f77 req-e23a1ee3-d21c-4903-b2bb-e03bdb10b384 service nova] Creating event network-vif-plugged:4708bad2-cbd1-44cd-9155-df4a2de8c416 for instance 255e860e-8389-4f93-b7d0-2d80d7b7ad7d on hv-cinder-84330 May 25 17:09:58.487150 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-9a39340f-d2a8-4a45-bd37-7595f3e98f77 req-e23a1ee3-d21c-4903-b2bb-e03bdb10b384 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042277 May 25 17:09:58.494205 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 46/112] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:09:58.564207 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2269151a-7e30-4af2-a815-98c40353b997 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:58.565462 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2269151a-7e30-4af2-a815-98c40353b997 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:58.571912 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2269151a-7e30-4af2-a815-98c40353b997 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:58.572575 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2269151a-7e30-4af2-a815-98c40353b997 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:58.573587 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2269151a-7e30-4af2-a815-98c40353b997 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:58.574211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2269151a-7e30-4af2-a815-98c40353b997 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:58.747531 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2269151a-7e30-4af2-a815-98c40353b997 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:58.756448 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2269151a-7e30-4af2-a815-98c40353b997 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:58.758010 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2269151a-7e30-4af2-a815-98c40353b997 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:58.759125 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2269151a-7e30-4af2-a815-98c40353b997 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.199676 May 25 17:09:58.760186 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 67/113] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:58 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:09:58.890704 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-638b87b6-fefc-4299-8ff4-eab4f6c31581 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:58.891402 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-638b87b6-fefc-4299-8ff4-eab4f6c31581 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:58.899315 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-638b87b6-fefc-4299-8ff4-eab4f6c31581 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:58.899771 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-638b87b6-fefc-4299-8ff4-eab4f6c31581 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:58.900802 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-638b87b6-fefc-4299-8ff4-eab4f6c31581 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:58.901247 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-638b87b6-fefc-4299-8ff4-eab4f6c31581 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:59.043816 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-638b87b6-fefc-4299-8ff4-eab4f6c31581 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:59.052462 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-638b87b6-fefc-4299-8ff4-eab4f6c31581 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.165735 May 25 17:09:59.053149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 47/114] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:58 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:59.225421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2eac6901-f467-404e-b580-937e170af4e0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:59.226058 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2eac6901-f467-404e-b580-937e170af4e0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:59.232114 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2eac6901-f467-404e-b580-937e170af4e0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:59.232566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2eac6901-f467-404e-b580-937e170af4e0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:59.233369 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2eac6901-f467-404e-b580-937e170af4e0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:59.233805 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2eac6901-f467-404e-b580-937e170af4e0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:59.279287 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d0036ce1-236d-4f63-a3ca-74f09ef930e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:59.279901 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d0036ce1-236d-4f63-a3ca-74f09ef930e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:59.286127 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d0036ce1-236d-4f63-a3ca-74f09ef930e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:59.286610 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d0036ce1-236d-4f63-a3ca-74f09ef930e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:59.287381 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d0036ce1-236d-4f63-a3ca-74f09ef930e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:59.287829 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d0036ce1-236d-4f63-a3ca-74f09ef930e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:59.371683 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2eac6901-f467-404e-b580-937e170af4e0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:59.380520 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2eac6901-f467-404e-b580-937e170af4e0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.158924 May 25 17:09:59.381131 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 68/115] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:59 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:09:59.420282 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d0036ce1-236d-4f63-a3ca-74f09ef930e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:59.428535 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d0036ce1-236d-4f63-a3ca-74f09ef930e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.153076 May 25 17:09:59.429129 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 48/116] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:09:59 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:09:59.777556 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4d61a4bd-0957-47d5-baaf-5f62c3ebd646 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:09:59.778176 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4d61a4bd-0957-47d5-baaf-5f62c3ebd646 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:09:59.784549 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4d61a4bd-0957-47d5-baaf-5f62c3ebd646 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:59.785029 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4d61a4bd-0957-47d5-baaf-5f62c3ebd646 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:59.785781 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4d61a4bd-0957-47d5-baaf-5f62c3ebd646 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:09:59.786211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4d61a4bd-0957-47d5-baaf-5f62c3ebd646 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:09:59.952050 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4d61a4bd-0957-47d5-baaf-5f62c3ebd646 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:59.961301 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4d61a4bd-0957-47d5-baaf-5f62c3ebd646 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:59.962815 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4d61a4bd-0957-47d5-baaf-5f62c3ebd646 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:09:59.963925 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4d61a4bd-0957-47d5-baaf-5f62c3ebd646 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.190207 May 25 17:09:59.964794 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 69/117] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:09:59 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:10:00.069959 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9e7636db-e979-4bdb-9d34-b6607b7fb9de tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:00.070578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9e7636db-e979-4bdb-9d34-b6607b7fb9de tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:00.077433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9e7636db-e979-4bdb-9d34-b6607b7fb9de tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:00.077894 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9e7636db-e979-4bdb-9d34-b6607b7fb9de tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:00.078667 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9e7636db-e979-4bdb-9d34-b6607b7fb9de tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:00.079117 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9e7636db-e979-4bdb-9d34-b6607b7fb9de tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:00.213046 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9e7636db-e979-4bdb-9d34-b6607b7fb9de tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:00.222458 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9e7636db-e979-4bdb-9d34-b6607b7fb9de tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.156322 May 25 17:10:00.223032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 49/118] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:00 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:00.398319 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-53b066e6-ca5a-4c55-8cc9-93ac1f6b6417 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:00.398924 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-53b066e6-ca5a-4c55-8cc9-93ac1f6b6417 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:00.405258 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-53b066e6-ca5a-4c55-8cc9-93ac1f6b6417 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:00.405633 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-53b066e6-ca5a-4c55-8cc9-93ac1f6b6417 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:00.406387 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-53b066e6-ca5a-4c55-8cc9-93ac1f6b6417 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:00.406815 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-53b066e6-ca5a-4c55-8cc9-93ac1f6b6417 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:00.446896 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-30c232d0-e83e-4998-82e6-483e11aef696 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:00.447609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-30c232d0-e83e-4998-82e6-483e11aef696 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:00.453806 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-30c232d0-e83e-4998-82e6-483e11aef696 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:00.454356 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-30c232d0-e83e-4998-82e6-483e11aef696 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:00.455933 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-30c232d0-e83e-4998-82e6-483e11aef696 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:00.456439 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-30c232d0-e83e-4998-82e6-483e11aef696 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:00.567033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-53b066e6-ca5a-4c55-8cc9-93ac1f6b6417 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:00.574610 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-53b066e6-ca5a-4c55-8cc9-93ac1f6b6417 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.180172 May 25 17:10:00.575703 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 70/119] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:00 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:00.621405 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-30c232d0-e83e-4998-82e6-483e11aef696 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:00.629308 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-30c232d0-e83e-4998-82e6-483e11aef696 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.187246 May 25 17:10:00.630088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 50/120] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:00 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:00.982788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b4cfa7a5-2f2e-4ebe-9387-46076be655fe tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:00.983483 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b4cfa7a5-2f2e-4ebe-9387-46076be655fe tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:00.990559 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b4cfa7a5-2f2e-4ebe-9387-46076be655fe tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:00.990998 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b4cfa7a5-2f2e-4ebe-9387-46076be655fe tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:00.991916 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b4cfa7a5-2f2e-4ebe-9387-46076be655fe tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:00.992521 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b4cfa7a5-2f2e-4ebe-9387-46076be655fe tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:01.170077 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b4cfa7a5-2f2e-4ebe-9387-46076be655fe tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:01.180670 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b4cfa7a5-2f2e-4ebe-9387-46076be655fe tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:01.182419 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b4cfa7a5-2f2e-4ebe-9387-46076be655fe tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:01.183539 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b4cfa7a5-2f2e-4ebe-9387-46076be655fe tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.204765 May 25 17:10:01.184115 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 71/121] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:10:00 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:10:01.240568 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-90ee45d9-b15f-4848-8dad-def7f8d1ee79 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:01.241210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-90ee45d9-b15f-4848-8dad-def7f8d1ee79 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:01.247902 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90ee45d9-b15f-4848-8dad-def7f8d1ee79 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:01.248289 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90ee45d9-b15f-4848-8dad-def7f8d1ee79 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:01.249972 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90ee45d9-b15f-4848-8dad-def7f8d1ee79 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:01.249972 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90ee45d9-b15f-4848-8dad-def7f8d1ee79 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:01.407329 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-90ee45d9-b15f-4848-8dad-def7f8d1ee79 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:01.428036 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-90ee45d9-b15f-4848-8dad-def7f8d1ee79 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.192827 May 25 17:10:01.428631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 51/122] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:01 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:01.591851 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e383cb9e-c031-4cab-be55-5a0aab49c2c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:01.595286 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e383cb9e-c031-4cab-be55-5a0aab49c2c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:01.625787 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e383cb9e-c031-4cab-be55-5a0aab49c2c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:01.627037 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e383cb9e-c031-4cab-be55-5a0aab49c2c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:01.628009 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e383cb9e-c031-4cab-be55-5a0aab49c2c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:01.628452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e383cb9e-c031-4cab-be55-5a0aab49c2c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:01.648453 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e77931a8-2b7e-4690-9032-5b11266aca8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:01.649224 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e77931a8-2b7e-4690-9032-5b11266aca8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:01.656528 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e77931a8-2b7e-4690-9032-5b11266aca8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:01.657029 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e77931a8-2b7e-4690-9032-5b11266aca8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:01.657847 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e77931a8-2b7e-4690-9032-5b11266aca8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:01.658491 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e77931a8-2b7e-4690-9032-5b11266aca8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:01.796403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e383cb9e-c031-4cab-be55-5a0aab49c2c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:01.800808 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=100 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:01.808618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e383cb9e-c031-4cab-be55-5a0aab49c2c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.220375 May 25 17:10:01.819329 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 72/123] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:01 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:01.841144 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e77931a8-2b7e-4690-9032-5b11266aca8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:01.852168 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e77931a8-2b7e-4690-9032-5b11266aca8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.209061 May 25 17:10:01.853364 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 52/124] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:01 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:02.208573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e136ac88-bffa-45cf-b32f-b67099facbf0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:02.209821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e136ac88-bffa-45cf-b32f-b67099facbf0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:02.218095 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e136ac88-bffa-45cf-b32f-b67099facbf0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:02.218755 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e136ac88-bffa-45cf-b32f-b67099facbf0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:02.219712 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e136ac88-bffa-45cf-b32f-b67099facbf0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:02.220406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e136ac88-bffa-45cf-b32f-b67099facbf0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:02.382140 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e136ac88-bffa-45cf-b32f-b67099facbf0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:02.393874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e136ac88-bffa-45cf-b32f-b67099facbf0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:02.395397 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e136ac88-bffa-45cf-b32f-b67099facbf0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:02.396515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e136ac88-bffa-45cf-b32f-b67099facbf0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.193073 May 25 17:10:02.397093 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 73/125] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:10:02 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:10:02.450198 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-487e6f7e-fef8-4d04-b235-6770d5624d87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:02.452108 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-487e6f7e-fef8-4d04-b235-6770d5624d87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:02.457613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:02.462674 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-487e6f7e-fef8-4d04-b235-6770d5624d87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:02.463219 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-487e6f7e-fef8-4d04-b235-6770d5624d87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:02.464012 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-487e6f7e-fef8-4d04-b235-6770d5624d87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:02.464455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-487e6f7e-fef8-4d04-b235-6770d5624d87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:02.762471 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-487e6f7e-fef8-4d04-b235-6770d5624d87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:02.771660 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-487e6f7e-fef8-4d04-b235-6770d5624d87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.327918 May 25 17:10:02.772504 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 53/126] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:02 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:02.826696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e7f4e231-0f06-4b84-9c25-522f21d7f469 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:02.827553 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e7f4e231-0f06-4b84-9c25-522f21d7f469 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:02.835328 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e7f4e231-0f06-4b84-9c25-522f21d7f469 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:02.836126 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e7f4e231-0f06-4b84-9c25-522f21d7f469 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:02.837559 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e7f4e231-0f06-4b84-9c25-522f21d7f469 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:02.838222 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e7f4e231-0f06-4b84-9c25-522f21d7f469 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:02.870875 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-90e54b05-f43e-477e-a88e-1e5593195431 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:02.871861 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-90e54b05-f43e-477e-a88e-1e5593195431 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:02.881260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90e54b05-f43e-477e-a88e-1e5593195431 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:02.881793 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90e54b05-f43e-477e-a88e-1e5593195431 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:02.882647 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90e54b05-f43e-477e-a88e-1e5593195431 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:02.883309 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90e54b05-f43e-477e-a88e-1e5593195431 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:03.027479 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e7f4e231-0f06-4b84-9c25-522f21d7f469 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:03.040191 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-90e54b05-f43e-477e-a88e-1e5593195431 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:03.040433 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e7f4e231-0f06-4b84-9c25-522f21d7f469 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.217587 May 25 17:10:03.044121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 74/127] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:02 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:03.053719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:03.053719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-90e54b05-f43e-477e-a88e-1e5593195431 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1364 microversion: 2.1 time: 0.185595 May 25 17:10:03.053719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 54/128] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:02 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:03.413224 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cd19d58b-4422-48d0-b9cb-82e208491222 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:03.413927 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cd19d58b-4422-48d0-b9cb-82e208491222 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:03.421836 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cd19d58b-4422-48d0-b9cb-82e208491222 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:03.422659 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cd19d58b-4422-48d0-b9cb-82e208491222 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:03.424083 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cd19d58b-4422-48d0-b9cb-82e208491222 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:03.424748 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cd19d58b-4422-48d0-b9cb-82e208491222 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:03.573012 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cd19d58b-4422-48d0-b9cb-82e208491222 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:03.583105 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cd19d58b-4422-48d0-b9cb-82e208491222 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:03.584630 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cd19d58b-4422-48d0-b9cb-82e208491222 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:03.586020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cd19d58b-4422-48d0-b9cb-82e208491222 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.176613 May 25 17:10:03.586767 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 55/129] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:10:03 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:10:03.792122 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-29260c08-427e-4dc2-9152-e506ffa3cce8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:03.793433 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-29260c08-427e-4dc2-9152-e506ffa3cce8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:03.802114 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-29260c08-427e-4dc2-9152-e506ffa3cce8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:03.802922 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-29260c08-427e-4dc2-9152-e506ffa3cce8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:03.803731 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-29260c08-427e-4dc2-9152-e506ffa3cce8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:03.804215 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-29260c08-427e-4dc2-9152-e506ffa3cce8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:03.950553 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-29260c08-427e-4dc2-9152-e506ffa3cce8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:03.958203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-29260c08-427e-4dc2-9152-e506ffa3cce8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.170093 May 25 17:10:03.958773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 75/130] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:03 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:04.062762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-777a4246-be38-4760-8c58-4a3c947975c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:04.062762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-777a4246-be38-4760-8c58-4a3c947975c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:04.070382 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-777a4246-be38-4760-8c58-4a3c947975c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.070976 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-777a4246-be38-4760-8c58-4a3c947975c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:04.071960 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-777a4246-be38-4760-8c58-4a3c947975c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.072557 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-777a4246-be38-4760-8c58-4a3c947975c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:04.076403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9cf85616-a781-4e65-b7f9-8c87c71c2d42 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:04.077118 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-9cf85616-a781-4e65-b7f9-8c87c71c2d42 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:04.085813 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9cf85616-a781-4e65-b7f9-8c87c71c2d42 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.086562 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9cf85616-a781-4e65-b7f9-8c87c71c2d42 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:04.087509 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9cf85616-a781-4e65-b7f9-8c87c71c2d42 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.088144 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9cf85616-a781-4e65-b7f9-8c87c71c2d42 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:04.244264 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-777a4246-be38-4760-8c58-4a3c947975c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:04.254416 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-777a4246-be38-4760-8c58-4a3c947975c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.196613 May 25 17:10:04.265180 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 56/131] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:04 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:04.276319 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9cf85616-a781-4e65-b7f9-8c87c71c2d42 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:04.284955 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9cf85616-a781-4e65-b7f9-8c87c71c2d42 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1547 microversion: 2.1 time: 0.215400 May 25 17:10:04.285716 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 76/132] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:04 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1547 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:04.306829 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0c826557-361e-4a95-8aed-5ec0c4693fbc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:04.307722 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0c826557-361e-4a95-8aed-5ec0c4693fbc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:04.314169 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c826557-361e-4a95-8aed-5ec0c4693fbc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.314840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c826557-361e-4a95-8aed-5ec0c4693fbc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:04.315749 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c826557-361e-4a95-8aed-5ec0c4693fbc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.316180 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c826557-361e-4a95-8aed-5ec0c4693fbc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:04.394258 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0c826557-361e-4a95-8aed-5ec0c4693fbc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096058 May 25 17:10:04.394958 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 57/133] 10.222.0.31 () {58 vars in 1274 bytes} [Wed May 25 17:10:04 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:10:04.605094 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1c336717-9261-4000-aa29-62146403a6d5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:04.605477 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1c336717-9261-4000-aa29-62146403a6d5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:04.612023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c336717-9261-4000-aa29-62146403a6d5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.612824 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c336717-9261-4000-aa29-62146403a6d5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:04.613805 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c336717-9261-4000-aa29-62146403a6d5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.614429 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c336717-9261-4000-aa29-62146403a6d5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:04.802236 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-c6252070-d1c8-4d93-ad0e-831cd5ac84f3 req-1cf98c48-7e1f-46a6-91a9-82d14ecf649c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99e2d9c-ac45-4a8e-8076-faaf830c29e0", "name": "network-vif-plugged", "status": "completed", "tag": "fa9d31d9-985b-4772-a564-1cbeee313f84"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:04.824794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-c6252070-d1c8-4d93-ad0e-831cd5ac84f3 req-1cf98c48-7e1f-46a6-91a9-82d14ecf649c service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.826714 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-c6252070-d1c8-4d93-ad0e-831cd5ac84f3 req-1cf98c48-7e1f-46a6-91a9-82d14ecf649c service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:04.855570 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-c6252070-d1c8-4d93-ad0e-831cd5ac84f3 req-1cf98c48-7e1f-46a6-91a9-82d14ecf649c service nova] Creating event network-vif-plugged:fa9d31d9-985b-4772-a564-1cbeee313f84 for instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 on hv-cinder-84330 May 25 17:10:04.858305 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1c336717-9261-4000-aa29-62146403a6d5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:04.869108 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1c336717-9261-4000-aa29-62146403a6d5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:04.870901 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-c6252070-d1c8-4d93-ad0e-831cd5ac84f3 req-1cf98c48-7e1f-46a6-91a9-82d14ecf649c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074644 May 25 17:10:04.873193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 58/134] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:10:04.875185 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1c336717-9261-4000-aa29-62146403a6d5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:04.878446 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1c336717-9261-4000-aa29-62146403a6d5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.277802 May 25 17:10:04.882952 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 77/135] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:10:04 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:10:04.975614 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f317e067-7385-4d2c-8892-98a3dddee3d5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:04.976597 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f317e067-7385-4d2c-8892-98a3dddee3d5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:04.996565 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f317e067-7385-4d2c-8892-98a3dddee3d5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.997424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f317e067-7385-4d2c-8892-98a3dddee3d5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:04.998579 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f317e067-7385-4d2c-8892-98a3dddee3d5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:04.999257 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f317e067-7385-4d2c-8892-98a3dddee3d5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:05.175549 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f317e067-7385-4d2c-8892-98a3dddee3d5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:05.184063 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f317e067-7385-4d2c-8892-98a3dddee3d5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1321 microversion: 2.1 time: 0.212734 May 25 17:10:05.185036 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 59/136] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:04 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:05.272958 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d99e2fde-2cc5-4a3b-8611-d59862ea949a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:05.273574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d99e2fde-2cc5-4a3b-8611-d59862ea949a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:05.279963 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d99e2fde-2cc5-4a3b-8611-d59862ea949a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:05.280408 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d99e2fde-2cc5-4a3b-8611-d59862ea949a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:05.281204 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d99e2fde-2cc5-4a3b-8611-d59862ea949a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:05.281639 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d99e2fde-2cc5-4a3b-8611-d59862ea949a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:05.734925 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d99e2fde-2cc5-4a3b-8611-d59862ea949a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:05.743932 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d99e2fde-2cc5-4a3b-8611-d59862ea949a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.474900 May 25 17:10:05.752910 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 78/137] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:05 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:05.899741 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b2b3572d-23e2-425f-b009-a20b7a9ec5ec tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:05.900480 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b2b3572d-23e2-425f-b009-a20b7a9ec5ec tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:05.912833 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2b3572d-23e2-425f-b009-a20b7a9ec5ec tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:05.913530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2b3572d-23e2-425f-b009-a20b7a9ec5ec tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:05.914569 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2b3572d-23e2-425f-b009-a20b7a9ec5ec tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:05.915581 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2b3572d-23e2-425f-b009-a20b7a9ec5ec tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:06.171300 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b2b3572d-23e2-425f-b009-a20b7a9ec5ec tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:06.189392 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b2b3572d-23e2-425f-b009-a20b7a9ec5ec tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:06.190933 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b2b3572d-23e2-425f-b009-a20b7a9ec5ec tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:06.192589 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b2b3572d-23e2-425f-b009-a20b7a9ec5ec tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.296913 May 25 17:10:06.193933 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 60/138] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:10:05 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:10:06.203561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f9101708-0e86-4774-8d59-64a53a27655e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:06.205771 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f9101708-0e86-4774-8d59-64a53a27655e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:06.213412 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f9101708-0e86-4774-8d59-64a53a27655e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:06.214339 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f9101708-0e86-4774-8d59-64a53a27655e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:06.217038 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f9101708-0e86-4774-8d59-64a53a27655e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:06.217866 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f9101708-0e86-4774-8d59-64a53a27655e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:06.521252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-be91ceac-459e-4a16-aa4b-6ff4de86cf7a req-ad75c667-a747-41dc-9a23-c55d3de75566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecb9b07-e50d-4926-b95d-af40c6093d83", "tag": "9a8368c6-6150-48dd-9dcf-3a607cd09518"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:06.530041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-be91ceac-459e-4a16-aa4b-6ff4de86cf7a req-ad75c667-a747-41dc-9a23-c55d3de75566 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:06.530862 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-be91ceac-459e-4a16-aa4b-6ff4de86cf7a req-ad75c667-a747-41dc-9a23-c55d3de75566 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:06.541532 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f9101708-0e86-4774-8d59-64a53a27655e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:06.547295 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-be91ceac-459e-4a16-aa4b-6ff4de86cf7a req-ad75c667-a747-41dc-9a23-c55d3de75566 service nova] Creating event network-changed:9a8368c6-6150-48dd-9dcf-3a607cd09518 for instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 on hv-cinder-84330 May 25 17:10:06.549056 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f9101708-0e86-4774-8d59-64a53a27655e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1515 microversion: 2.1 time: 0.350000 May 25 17:10:06.553007 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 79/139] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:06 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1515 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:06.555273 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-be91ceac-459e-4a16-aa4b-6ff4de86cf7a req-ad75c667-a747-41dc-9a23-c55d3de75566 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039083 May 25 17:10:06.556389 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 61/140] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:10:06.568441 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8b012aa8-38b2-4649-990c-e718c83e47ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:06.569530 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8b012aa8-38b2-4649-990c-e718c83e47ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:06.578729 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8b012aa8-38b2-4649-990c-e718c83e47ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:06.582425 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8b012aa8-38b2-4649-990c-e718c83e47ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:06.583088 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8b012aa8-38b2-4649-990c-e718c83e47ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:06.583531 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8b012aa8-38b2-4649-990c-e718c83e47ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:06.729780 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-8b012aa8-38b2-4649-990c-e718c83e47ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lazy-loading 'flavor' on Instance uuid 255e860e-8389-4f93-b7d0-2d80d7b7ad7d {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:10:06.761927 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-81f6d080-7690-4271-b2cf-465d95e1670f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:06.762613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-81f6d080-7690-4271-b2cf-465d95e1670f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:06.777242 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81f6d080-7690-4271-b2cf-465d95e1670f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:06.778100 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81f6d080-7690-4271-b2cf-465d95e1670f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:06.778767 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81f6d080-7690-4271-b2cf-465d95e1670f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:06.779203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81f6d080-7690-4271-b2cf-465d95e1670f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:07.230822 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8b012aa8-38b2-4649-990c-e718c83e47ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d/action" status: 200 len: 32 microversion: 2.1 time: 0.666719 May 25 17:10:07.236176 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 80/141] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:10:06 2022] POST /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d/action => generated 32 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 17:10:07.242602 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-48442f36-2d54-4598-b735-96b2f2a63d63 req-58d8495d-d4a6-45c2-9b3a-d7d55624d057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4176ef9b-9601-4e3d-bc52-51854be03fd7", "name": "network-vif-plugged", "status": "completed", "tag": "fb7d08f7-f9a7-41b7-9a81-da056a75e0de"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:07.261033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-48442f36-2d54-4598-b735-96b2f2a63d63 req-58d8495d-d4a6-45c2-9b3a-d7d55624d057 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:07.263256 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-48442f36-2d54-4598-b735-96b2f2a63d63 req-58d8495d-d4a6-45c2-9b3a-d7d55624d057 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:07.287288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-48442f36-2d54-4598-b735-96b2f2a63d63 req-58d8495d-d4a6-45c2-9b3a-d7d55624d057 service nova] Creating event network-vif-plugged:fb7d08f7-f9a7-41b7-9a81-da056a75e0de for instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 on hv-cinder-84330 May 25 17:10:07.299458 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-48442f36-2d54-4598-b735-96b2f2a63d63 req-58d8495d-d4a6-45c2-9b3a-d7d55624d057 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060688 May 25 17:10:07.304978 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 81/142] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:10:07.306882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-81f6d080-7690-4271-b2cf-465d95e1670f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:07.312939 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0e2cb669-e665-4114-aca4-57c3113541ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:07.318417 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-81f6d080-7690-4271-b2cf-465d95e1670f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.560552 May 25 17:10:07.318966 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0e2cb669-e665-4114-aca4-57c3113541ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:07.333142 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e2cb669-e665-4114-aca4-57c3113541ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:07.336026 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e2cb669-e665-4114-aca4-57c3113541ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:07.338156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e2cb669-e665-4114-aca4-57c3113541ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:07.339553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 62/143] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:06 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:07.341267 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e2cb669-e665-4114-aca4-57c3113541ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:07.344741 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-63da02b3-7f32-4ede-977e-f6040b59419c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:07.345941 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-63da02b3-7f32-4ede-977e-f6040b59419c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:07.364990 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-63da02b3-7f32-4ede-977e-f6040b59419c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:07.365585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-63da02b3-7f32-4ede-977e-f6040b59419c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:07.366458 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-63da02b3-7f32-4ede-977e-f6040b59419c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:07.366998 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-63da02b3-7f32-4ede-977e-f6040b59419c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:07.591522 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0e2cb669-e665-4114-aca4-57c3113541ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:07.603266 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0e2cb669-e665-4114-aca4-57c3113541ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:07.605617 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0e2cb669-e665-4114-aca4-57c3113541ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:07.619593 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0e2cb669-e665-4114-aca4-57c3113541ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.303593 May 25 17:10:07.620691 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 82/144] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:10:07 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:10:07.628302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-726389f9-ec6b-4733-83fe-c33910de9b41 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:07.629139 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-726389f9-ec6b-4733-83fe-c33910de9b41 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:07.655315 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-726389f9-ec6b-4733-83fe-c33910de9b41 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:07.656121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-726389f9-ec6b-4733-83fe-c33910de9b41 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:07.659364 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-726389f9-ec6b-4733-83fe-c33910de9b41 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:07.660654 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-726389f9-ec6b-4733-83fe-c33910de9b41 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:07.750823 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-726389f9-ec6b-4733-83fe-c33910de9b41 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:10:07.843674 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-63da02b3-7f32-4ede-977e-f6040b59419c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:07.854521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-63da02b3-7f32-4ede-977e-f6040b59419c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.513755 May 25 17:10:07.861709 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 63/145] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:07 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:07.956538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-726389f9-ec6b-4733-83fe-c33910de9b41 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "DELETE /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 204 len: 0 microversion: 2.1 time: 0.334112 May 25 17:10:07.957563 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 83/146] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:10:07 2022] DELETE /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:10:07.965796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e4370c0d-424c-4b33-9590-68d2ff451795 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:07.966400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e4370c0d-424c-4b33-9590-68d2ff451795 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:07.982674 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4370c0d-424c-4b33-9590-68d2ff451795 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:07.983131 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4370c0d-424c-4b33-9590-68d2ff451795 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:07.983923 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4370c0d-424c-4b33-9590-68d2ff451795 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:07.990002 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4370c0d-424c-4b33-9590-68d2ff451795 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:08.347437 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-71a62e6f-82ad-4dfc-b098-441134878951 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:08.348135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-71a62e6f-82ad-4dfc-b098-441134878951 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:08.366988 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-71a62e6f-82ad-4dfc-b098-441134878951 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:08.368035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-71a62e6f-82ad-4dfc-b098-441134878951 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:08.369664 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-71a62e6f-82ad-4dfc-b098-441134878951 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:08.370288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-71a62e6f-82ad-4dfc-b098-441134878951 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:08.428640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e4370c0d-424c-4b33-9590-68d2ff451795 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:08.441374 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e4370c0d-424c-4b33-9590-68d2ff451795 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1552 microversion: 2.1 time: 0.479320 May 25 17:10:08.442138 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 64/147] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:07 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1552 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:08.578967 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-71a62e6f-82ad-4dfc-b098-441134878951 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:08.589413 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-71a62e6f-82ad-4dfc-b098-441134878951 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.246561 May 25 17:10:08.590554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 84/148] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:08 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:08.646904 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8eb0e6de-7926-490b-96c9-de7947844a9b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:08.647679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8eb0e6de-7926-490b-96c9-de7947844a9b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:08.655783 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8eb0e6de-7926-490b-96c9-de7947844a9b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:08.656342 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8eb0e6de-7926-490b-96c9-de7947844a9b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:08.657451 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8eb0e6de-7926-490b-96c9-de7947844a9b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:08.658650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8eb0e6de-7926-490b-96c9-de7947844a9b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:08.833629 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8eb0e6de-7926-490b-96c9-de7947844a9b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:08.844046 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8eb0e6de-7926-490b-96c9-de7947844a9b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:08.846932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8eb0e6de-7926-490b-96c9-de7947844a9b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:08.848361 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8eb0e6de-7926-490b-96c9-de7947844a9b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1406 microversion: 2.20 time: 0.211587 May 25 17:10:08.849487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 65/149] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:10:08 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:10:08.879262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4c038935-3dc8-475d-9cdb-5579ca1b8530 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:08.879948 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4c038935-3dc8-475d-9cdb-5579ca1b8530 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:08.886444 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4c038935-3dc8-475d-9cdb-5579ca1b8530 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:08.886920 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4c038935-3dc8-475d-9cdb-5579ca1b8530 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:08.887726 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4c038935-3dc8-475d-9cdb-5579ca1b8530 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:08.888167 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4c038935-3dc8-475d-9cdb-5579ca1b8530 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:09.060586 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4c038935-3dc8-475d-9cdb-5579ca1b8530 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:09.075935 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4c038935-3dc8-475d-9cdb-5579ca1b8530 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.201093 May 25 17:10:09.076850 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 85/150] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:08 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:09.459800 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2512294f-9aad-4804-aada-9636ceaffd6a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:09.460442 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2512294f-9aad-4804-aada-9636ceaffd6a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:09.467378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2512294f-9aad-4804-aada-9636ceaffd6a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:09.467917 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2512294f-9aad-4804-aada-9636ceaffd6a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:09.468720 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2512294f-9aad-4804-aada-9636ceaffd6a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:09.469520 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2512294f-9aad-4804-aada-9636ceaffd6a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:09.607540 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e1538199-f400-4ec4-8e74-3c353aad0be4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:09.608313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e1538199-f400-4ec4-8e74-3c353aad0be4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:09.617818 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e1538199-f400-4ec4-8e74-3c353aad0be4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:09.620122 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e1538199-f400-4ec4-8e74-3c353aad0be4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:09.621374 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e1538199-f400-4ec4-8e74-3c353aad0be4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:09.623275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e1538199-f400-4ec4-8e74-3c353aad0be4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:09.672851 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:09.835946 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e1538199-f400-4ec4-8e74-3c353aad0be4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:09.850486 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e1538199-f400-4ec4-8e74-3c353aad0be4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.246684 May 25 17:10:09.851069 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 86/151] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:09 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:09.880922 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-39a3b1d9-7361-4552-9744-10586d11ed65 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:09.882116 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-39a3b1d9-7361-4552-9744-10586d11ed65 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:09.891232 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-39a3b1d9-7361-4552-9744-10586d11ed65 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:09.892521 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-39a3b1d9-7361-4552-9744-10586d11ed65 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:09.894796 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-39a3b1d9-7361-4552-9744-10586d11ed65 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:09.895216 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-39a3b1d9-7361-4552-9744-10586d11ed65 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:09.896483 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2512294f-9aad-4804-aada-9636ceaffd6a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:09.909447 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2512294f-9aad-4804-aada-9636ceaffd6a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1552 microversion: 2.1 time: 0.452093 May 25 17:10:09.911252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 66/152] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:09 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1552 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:10.067545 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-39a3b1d9-7361-4552-9744-10586d11ed65 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:10.076399 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-39a3b1d9-7361-4552-9744-10586d11ed65 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:10.077949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-39a3b1d9-7361-4552-9744-10586d11ed65 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:10.079162 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-39a3b1d9-7361-4552-9744-10586d11ed65 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1598 microversion: 2.20 time: 0.210932 May 25 17:10:10.080247 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 87/153] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:10:09 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1598 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:10:10.094109 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5f897e89-25a4-445c-99f0-ecae9f39284a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:10.095320 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5f897e89-25a4-445c-99f0-ecae9f39284a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:10.102741 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5f897e89-25a4-445c-99f0-ecae9f39284a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:10.102921 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-20bcfc19-5483-44d6-96dc-fa2a644e61fc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:10.103109 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5f897e89-25a4-445c-99f0-ecae9f39284a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:10.103309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-20bcfc19-5483-44d6-96dc-fa2a644e61fc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:10.104596 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5f897e89-25a4-445c-99f0-ecae9f39284a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:10.106737 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5f897e89-25a4-445c-99f0-ecae9f39284a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:10.109772 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-20bcfc19-5483-44d6-96dc-fa2a644e61fc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:10.110408 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-20bcfc19-5483-44d6-96dc-fa2a644e61fc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:10.111214 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-20bcfc19-5483-44d6-96dc-fa2a644e61fc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:10.111827 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-20bcfc19-5483-44d6-96dc-fa2a644e61fc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:10.195352 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-20bcfc19-5483-44d6-96dc-fa2a644e61fc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096982 May 25 17:10:10.196271 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 88/154] 10.222.0.31 () {60 vars in 1315 bytes} [Wed May 25 17:10:10 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:10:10.280794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5f897e89-25a4-445c-99f0-ecae9f39284a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:10.289568 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5f897e89-25a4-445c-99f0-ecae9f39284a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.199664 May 25 17:10:10.290183 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 67/155] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:10 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:10.869299 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9594fe50-49a3-41c8-a03b-5c29754c63c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:10.871065 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-9594fe50-49a3-41c8-a03b-5c29754c63c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:10.881408 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9594fe50-49a3-41c8-a03b-5c29754c63c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:10.883233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9594fe50-49a3-41c8-a03b-5c29754c63c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:10.886180 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9594fe50-49a3-41c8-a03b-5c29754c63c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:10.887764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9594fe50-49a3-41c8-a03b-5c29754c63c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:10.930890 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c061a8ab-e590-4e36-b31f-3ba08e19a40b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:10.932433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c061a8ab-e590-4e36-b31f-3ba08e19a40b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:10.962004 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c061a8ab-e590-4e36-b31f-3ba08e19a40b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:10.965092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c061a8ab-e590-4e36-b31f-3ba08e19a40b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:10.965897 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c061a8ab-e590-4e36-b31f-3ba08e19a40b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:10.970574 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c061a8ab-e590-4e36-b31f-3ba08e19a40b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:11.205831 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c061a8ab-e590-4e36-b31f-3ba08e19a40b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:11.243505 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c061a8ab-e590-4e36-b31f-3ba08e19a40b tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1552 microversion: 2.1 time: 0.315145 May 25 17:10:11.246652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 68/156] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:10 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1552 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:11.308294 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8deb255c-b9c6-4dcc-9699-9bfb8689a235 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:11.308942 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8deb255c-b9c6-4dcc-9699-9bfb8689a235 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:11.322295 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8deb255c-b9c6-4dcc-9699-9bfb8689a235 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:11.329220 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8deb255c-b9c6-4dcc-9699-9bfb8689a235 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:11.330018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9594fe50-49a3-41c8-a03b-5c29754c63c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:11.333088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8deb255c-b9c6-4dcc-9699-9bfb8689a235 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:11.339899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8deb255c-b9c6-4dcc-9699-9bfb8689a235 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:11.344242 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9594fe50-49a3-41c8-a03b-5c29754c63c3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1367 microversion: 2.1 time: 0.480387 May 25 17:10:11.354835 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 89/157] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:10 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:11.656328 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8deb255c-b9c6-4dcc-9699-9bfb8689a235 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:11.670763 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8deb255c-b9c6-4dcc-9699-9bfb8689a235 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.367241 May 25 17:10:11.684765 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 69/158] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:11 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:12.166105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-ebb551a7-7b34-43b5-89ac-ada9da2c75cf req-7faf48c6-2540-4c92-9bda-8503f3af8301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99e2d9c-ac45-4a8e-8076-faaf830c29e0", "tag": "fa9d31d9-985b-4772-a564-1cbeee313f84"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:12.181660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-ebb551a7-7b34-43b5-89ac-ada9da2c75cf req-7faf48c6-2540-4c92-9bda-8503f3af8301 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:12.182119 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-ebb551a7-7b34-43b5-89ac-ada9da2c75cf req-7faf48c6-2540-4c92-9bda-8503f3af8301 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:12.200710 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-ebb551a7-7b34-43b5-89ac-ada9da2c75cf req-7faf48c6-2540-4c92-9bda-8503f3af8301 service nova] Creating event network-changed:fa9d31d9-985b-4772-a564-1cbeee313f84 for instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 on hv-cinder-84330 May 25 17:10:12.207670 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-ebb551a7-7b34-43b5-89ac-ada9da2c75cf req-7faf48c6-2540-4c92-9bda-8503f3af8301 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045194 May 25 17:10:12.208491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 90/159] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:10:12.264798 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-15e15f99-f566-45a9-937c-ef221d3bb6ee tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:12.265421 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-15e15f99-f566-45a9-937c-ef221d3bb6ee tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:12.271790 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15e15f99-f566-45a9-937c-ef221d3bb6ee tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:12.272234 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15e15f99-f566-45a9-937c-ef221d3bb6ee tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:12.273018 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15e15f99-f566-45a9-937c-ef221d3bb6ee tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:12.280478 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15e15f99-f566-45a9-937c-ef221d3bb6ee tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:12.363982 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a62a9591-2e21-4016-8873-7a412c990313 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:12.364762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a62a9591-2e21-4016-8873-7a412c990313 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:12.383446 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a62a9591-2e21-4016-8873-7a412c990313 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:12.384062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a62a9591-2e21-4016-8873-7a412c990313 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:12.384956 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a62a9591-2e21-4016-8873-7a412c990313 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:12.385405 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a62a9591-2e21-4016-8873-7a412c990313 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:12.426577 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-15e15f99-f566-45a9-937c-ef221d3bb6ee tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:12.446225 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-15e15f99-f566-45a9-937c-ef221d3bb6ee tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1510 microversion: 2.1 time: 0.184298 May 25 17:10:12.448574 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 70/160] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:12 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:12.471598 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-7beb131c-ccb8-40d3-a63f-34b5ae7902df req-89bb4c36-dcd1-495b-84ec-4dfe49b5a248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a815e8-f0d5-4121-9124-d96e02afa8b2", "name": "network-vif-deleted", "tag": "adbfec7d-46e1-477d-8236-36f39e8d299f"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:12.501960 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-7beb131c-ccb8-40d3-a63f-34b5ae7902df req-89bb4c36-dcd1-495b-84ec-4dfe49b5a248 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:12.505275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-7beb131c-ccb8-40d3-a63f-34b5ae7902df req-89bb4c36-dcd1-495b-84ec-4dfe49b5a248 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:12.535191 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-7beb131c-ccb8-40d3-a63f-34b5ae7902df req-89bb4c36-dcd1-495b-84ec-4dfe49b5a248 service nova] Creating event network-vif-deleted:adbfec7d-46e1-477d-8236-36f39e8d299f for instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 on hv-cinder-84330 May 25 17:10:12.547492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-7beb131c-ccb8-40d3-a63f-34b5ae7902df req-89bb4c36-dcd1-495b-84ec-4dfe49b5a248 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093906 May 25 17:10:12.552151 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 71/161] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:10:12.687675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-316a37c6-15e6-47ee-a04f-32359a7b7323 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:12.688670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-316a37c6-15e6-47ee-a04f-32359a7b7323 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:12.708264 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-316a37c6-15e6-47ee-a04f-32359a7b7323 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:12.713393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-316a37c6-15e6-47ee-a04f-32359a7b7323 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:12.716120 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-316a37c6-15e6-47ee-a04f-32359a7b7323 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:12.717207 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-316a37c6-15e6-47ee-a04f-32359a7b7323 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:12.789748 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a62a9591-2e21-4016-8873-7a412c990313 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:12.804272 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a62a9591-2e21-4016-8873-7a412c990313 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1557 microversion: 2.1 time: 0.445958 May 25 17:10:12.806272 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 91/162] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:12 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1557 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:12.828129 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-931ff55e-73c0-45dd-9625-618572ea1dff tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:12.828822 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-931ff55e-73c0-45dd-9625-618572ea1dff tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:12.846948 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-931ff55e-73c0-45dd-9625-618572ea1dff tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:12.850055 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-931ff55e-73c0-45dd-9625-618572ea1dff tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:12.851244 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-931ff55e-73c0-45dd-9625-618572ea1dff tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:12.853856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-931ff55e-73c0-45dd-9625-618572ea1dff tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:13.010220 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-316a37c6-15e6-47ee-a04f-32359a7b7323 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:13.025933 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-316a37c6-15e6-47ee-a04f-32359a7b7323 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.342298 May 25 17:10:13.029810 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 72/163] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:12 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:13.034889 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-931ff55e-73c0-45dd-9625-618572ea1dff tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212580 May 25 17:10:13.035604 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 92/164] 10.222.0.31 () {58 vars in 1274 bytes} [Wed May 25 17:10:12 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:10:13.468600 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:13.471465 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:13.487399 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:13.489570 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:13.491798 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:13.493416 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:13.571208 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:13.574575 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:13.576216 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lazy-loading 'fault' on Instance uuid 57a815e8-f0d5-4121-9124-d96e02afa8b2 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:10:13.597645 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:13.697326 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e111e4a0df4636ac9dc837f511e487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a454e276d3405a93a67513e1a12126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:13.711441 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-164ef5f6-f789-41fd-a00f-f6f0fcae9065 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 200 len: 1305 microversion: 2.1 time: 0.248636 May 25 17:10:13.712040 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 73/165] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:13 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 1305 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:14.054367 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6430d6b4-64f0-4f46-a70a-e4cb632447f4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:14.055578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6430d6b4-64f0-4f46-a70a-e4cb632447f4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:14.062947 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6430d6b4-64f0-4f46-a70a-e4cb632447f4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:14.063679 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6430d6b4-64f0-4f46-a70a-e4cb632447f4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:14.066031 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6430d6b4-64f0-4f46-a70a-e4cb632447f4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:14.067248 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6430d6b4-64f0-4f46-a70a-e4cb632447f4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:14.298511 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6430d6b4-64f0-4f46-a70a-e4cb632447f4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:14.307046 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6430d6b4-64f0-4f46-a70a-e4cb632447f4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.263875 May 25 17:10:14.307563 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 93/166] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:14 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:14.729182 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-607d62c3-2f97-4471-99f7-58521553272a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:14.729818 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-607d62c3-2f97-4471-99f7-58521553272a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:14.737194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-607d62c3-2f97-4471-99f7-58521553272a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:14.737460 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-607d62c3-2f97-4471-99f7-58521553272a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:14.741910 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-607d62c3-2f97-4471-99f7-58521553272a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:14.742400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-607d62c3-2f97-4471-99f7-58521553272a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:14.771071 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-607d62c3-2f97-4471-99f7-58521553272a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] HTTP exception thrown: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-607d62c3-2f97-4471-99f7-58521553272a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Request method failure captured: May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 HTTP/1.1 May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmKxwAQPBWfr7EOXwjwSvZAq4tjtt4yfQo3QMNchA9Kjj4MCOB8xRIqDdABQqZZbTKBV-dCSYyOpTSaC7b7JO5pAif4vBQ-yOZBlUqRGqCbjR9PIjs47lYjtq44Ln9oQJZNdKqiZ1Z4t4iohjnEJgt4ZrQEd3pjm2QWSPlJVTh-TJQU May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 23a454e276d3405a93a67513e1a12126 May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-DeleteServersTestJSON-509540476 May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:10:14.779349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_23a454e276d3405a93a67513e1a12126"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/23a454e276d3405a93a67513e1a12126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/23a454e276d3405a93a67513e1a12126"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/23a454e276d3405a93a67513e1a12126"}]}] May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-DeleteServersTestJSON-509540476 May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 23a454e276d3405a93a67513e1a12126 May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-DeleteServersTestJSON-509540476 May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-DeleteServersTestJSON-509540476-project May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 83e111e4a0df4636ac9dc837f511e487 May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-DeleteServersTestJSON-509540476-project May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:14.780560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '57a815e8-f0d5-4121-9124-d96e02afa8b2'} May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:10:14.781263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:14.782379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:14.783850 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-607d62c3-2f97-4471-99f7-58521553272a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Returning 404 to user: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:10:14.783850 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-607d62c3-2f97-4471-99f7-58521553272a tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 404 len: 111 microversion: 2.1 time: 0.055521 May 25 17:10:14.783850 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 74/167] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:14 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:10:14.976220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-df720787-0456-4c03-8e28-1f2532d1bd9c tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:14.977696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-df720787-0456-4c03-8e28-1f2532d1bd9c tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:14.985604 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df720787-0456-4c03-8e28-1f2532d1bd9c tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:14.989559 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df720787-0456-4c03-8e28-1f2532d1bd9c tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:14.990833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df720787-0456-4c03-8e28-1f2532d1bd9c tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:14.993095 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df720787-0456-4c03-8e28-1f2532d1bd9c tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:15.023949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-df720787-0456-4c03-8e28-1f2532d1bd9c tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] HTTP exception thrown: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-df720787-0456-4c03-8e28-1f2532d1bd9c tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Request method failure captured: May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2/os-volume_attachments HTTP/1.1 May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmKxwAQPBWfr7EOXwjwSvZAq4tjtt4yfQo3QMNchA9Kjj4MCOB8xRIqDdABQqZZbTKBV-dCSYyOpTSaC7b7JO5pAif4vBQ-yOZBlUqRGqCbjR9PIjs47lYjtq44Ln9oQJZNdKqiZ1Z4t4iohjnEJgt4ZrQEd3pjm2QWSPlJVTh-TJQU May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 23a454e276d3405a93a67513e1a12126 May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-DeleteServersTestJSON-509540476 May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:10:15.034821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_23a454e276d3405a93a67513e1a12126"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/23a454e276d3405a93a67513e1a12126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/23a454e276d3405a93a67513e1a12126"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/23a454e276d3405a93a67513e1a12126"}]}] May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-DeleteServersTestJSON-509540476 May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 23a454e276d3405a93a67513e1a12126 May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-DeleteServersTestJSON-509540476 May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-DeleteServersTestJSON-509540476-project May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 83e111e4a0df4636ac9dc837f511e487 May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-DeleteServersTestJSON-509540476-project May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:15.036275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'server_id': '57a815e8-f0d5-4121-9124-d96e02afa8b2'} May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:10:15.037135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:15.038395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:15.041632 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-df720787-0456-4c03-8e28-1f2532d1bd9c tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Returning 404 to user: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:10:15.042657 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-df720787-0456-4c03-8e28-1f2532d1bd9c tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.070530 May 25 17:10:15.044486 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 94/168] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:10:14 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2/os-volume_attachments => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:10:15.327179 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9cc3e063-704b-4d74-979a-d6ddfb0750db tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:15.328466 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9cc3e063-704b-4d74-979a-d6ddfb0750db tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:15.344891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9cc3e063-704b-4d74-979a-d6ddfb0750db tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:15.347307 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9cc3e063-704b-4d74-979a-d6ddfb0750db tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:15.352537 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9cc3e063-704b-4d74-979a-d6ddfb0750db tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:15.353782 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9cc3e063-704b-4d74-979a-d6ddfb0750db tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:15.442428 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-d074fa04-83d6-4ac2-b503-5e1019f9db3a req-09f9280a-890d-4e7d-9373-4ab80100f242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4176ef9b-9601-4e3d-bc52-51854be03fd7", "tag": "fb7d08f7-f9a7-41b7-9a81-da056a75e0de"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:15.456161 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-d074fa04-83d6-4ac2-b503-5e1019f9db3a req-09f9280a-890d-4e7d-9373-4ab80100f242 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:15.456974 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-d074fa04-83d6-4ac2-b503-5e1019f9db3a req-09f9280a-890d-4e7d-9373-4ab80100f242 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:15.473309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-d074fa04-83d6-4ac2-b503-5e1019f9db3a req-09f9280a-890d-4e7d-9373-4ab80100f242 service nova] Creating event network-changed:fb7d08f7-f9a7-41b7-9a81-da056a75e0de for instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 on hv-cinder-84330 May 25 17:10:15.481957 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-d074fa04-83d6-4ac2-b503-5e1019f9db3a req-09f9280a-890d-4e7d-9373-4ab80100f242 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044579 May 25 17:10:15.483260 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 95/169] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:10:15.587419 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9cc3e063-704b-4d74-979a-d6ddfb0750db tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:15.597327 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9cc3e063-704b-4d74-979a-d6ddfb0750db tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.276016 May 25 17:10:15.599929 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 75/170] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:15 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:16.464438 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-217ca502-290c-4bb0-a347-a91a7c8521a3 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:16.465082 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-217ca502-290c-4bb0-a347-a91a7c8521a3 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:16.477203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-217ca502-290c-4bb0-a347-a91a7c8521a3 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:16.482374 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-217ca502-290c-4bb0-a347-a91a7c8521a3 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:16.483320 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-217ca502-290c-4bb0-a347-a91a7c8521a3 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:16.483783 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-217ca502-290c-4bb0-a347-a91a7c8521a3 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:16.505708 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-217ca502-290c-4bb0-a347-a91a7c8521a3 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] HTTP exception thrown: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-217ca502-290c-4bb0-a347-a91a7c8521a3 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Request method failure captured: May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: DELETE /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 HTTP/1.1 May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmKxwAQPBWfr7EOXwjwSvZAq4tjtt4yfQo3QMNchA9Kjj4MCOB8xRIqDdABQqZZbTKBV-dCSYyOpTSaC7b7JO5pAif4vBQ-yOZBlUqRGqCbjR9PIjs47lYjtq44Ln9oQJZNdKqiZ1Z4t4iohjnEJgt4ZrQEd3pjm2QWSPlJVTh-TJQU May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 23a454e276d3405a93a67513e1a12126 May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-DeleteServersTestJSON-509540476 May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:10:16.508484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_23a454e276d3405a93a67513e1a12126"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/23a454e276d3405a93a67513e1a12126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/23a454e276d3405a93a67513e1a12126"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/23a454e276d3405a93a67513e1a12126"}]}] May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-DeleteServersTestJSON-509540476 May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 23a454e276d3405a93a67513e1a12126 May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-DeleteServersTestJSON-509540476 May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-DeleteServersTestJSON-509540476-project May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 83e111e4a0df4636ac9dc837f511e487 May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-DeleteServersTestJSON-509540476-project May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:16.510240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '57a815e8-f0d5-4121-9124-d96e02afa8b2'} May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:10:16.514200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:16.515571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:16.516627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-217ca502-290c-4bb0-a347-a91a7c8521a3 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Returning 404 to user: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:10:16.516627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-217ca502-290c-4bb0-a347-a91a7c8521a3 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "DELETE /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 404 len: 111 microversion: 2.1 time: 0.050476 May 25 17:10:16.516627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 96/171] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:10:16 2022] DELETE /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:10:16.519223 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a76c4482-7b97-4b30-9ef1-150bac800bb2 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:16.519842 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a76c4482-7b97-4b30-9ef1-150bac800bb2 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] [instance: 57a815e8-f0d5-4121-9124-d96e02afa8b2] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:16.527533 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a76c4482-7b97-4b30-9ef1-150bac800bb2 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:16.527664 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a76c4482-7b97-4b30-9ef1-150bac800bb2 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:16.528359 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a76c4482-7b97-4b30-9ef1-150bac800bb2 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:16.528870 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a76c4482-7b97-4b30-9ef1-150bac800bb2 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:16.545479 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-a76c4482-7b97-4b30-9ef1-150bac800bb2 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] HTTP exception thrown: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a76c4482-7b97-4b30-9ef1-150bac800bb2 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Request method failure captured: May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 HTTP/1.1 May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmKxwAQPBWfr7EOXwjwSvZAq4tjtt4yfQo3QMNchA9Kjj4MCOB8xRIqDdABQqZZbTKBV-dCSYyOpTSaC7b7JO5pAif4vBQ-yOZBlUqRGqCbjR9PIjs47lYjtq44Ln9oQJZNdKqiZ1Z4t4iohjnEJgt4ZrQEd3pjm2QWSPlJVTh-TJQU May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 23a454e276d3405a93a67513e1a12126 May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-DeleteServersTestJSON-509540476 May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:10:16.547032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_23a454e276d3405a93a67513e1a12126"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/23a454e276d3405a93a67513e1a12126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/23a454e276d3405a93a67513e1a12126"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/23a454e276d3405a93a67513e1a12126"}]}] May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-DeleteServersTestJSON-509540476 May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 23a454e276d3405a93a67513e1a12126 May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-DeleteServersTestJSON-509540476 May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-DeleteServersTestJSON-509540476-project May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 83e111e4a0df4636ac9dc837f511e487 May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-DeleteServersTestJSON-509540476-project May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:16.548840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '57a815e8-f0d5-4121-9124-d96e02afa8b2'} May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:10:16.549485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. May 25 17:10:16.554186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:16.557355 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a76c4482-7b97-4b30-9ef1-150bac800bb2 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] Returning 404 to user: Instance 57a815e8-f0d5-4121-9124-d96e02afa8b2 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:10:16.557355 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a76c4482-7b97-4b30-9ef1-150bac800bb2 tempest-DeleteServersTestJSON-509540476 tempest-DeleteServersTestJSON-509540476-project] 10.222.0.31 "GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2" status: 404 len: 111 microversion: 2.1 time: 0.034055 May 25 17:10:16.557355 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 76/172] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:16 2022] GET /compute/v2.1/servers/57a815e8-f0d5-4121-9124-d96e02afa8b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:10:16.618965 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3735bc92-2581-447c-99f5-e207947dccdc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:16.619517 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3735bc92-2581-447c-99f5-e207947dccdc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:16.628302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3735bc92-2581-447c-99f5-e207947dccdc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:16.628791 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3735bc92-2581-447c-99f5-e207947dccdc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:16.629674 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3735bc92-2581-447c-99f5-e207947dccdc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:16.630134 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3735bc92-2581-447c-99f5-e207947dccdc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:16.869338 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3735bc92-2581-447c-99f5-e207947dccdc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:16.881181 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3735bc92-2581-447c-99f5-e207947dccdc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.266642 May 25 17:10:16.882209 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 97/173] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:16 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:17.177016 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1405735579", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "networks": [{"uuid": "f275f7e0-7ca7-4997-ab2c-da8062808dee"}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:17.230443 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] validate_networks() for [('f275f7e0-7ca7-4997-ab2c-da8062808dee', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:10:17.898789 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b4501920-b12b-4aae-b179-28d437f27708 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:17.900025 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b4501920-b12b-4aae-b179-28d437f27708 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:17.908853 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b4501920-b12b-4aae-b179-28d437f27708 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:17.909660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b4501920-b12b-4aae-b179-28d437f27708 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:17.910668 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b4501920-b12b-4aae-b179-28d437f27708 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:17.911312 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b4501920-b12b-4aae-b179-28d437f27708 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:18.018540 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:10:18.019092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:10:18.019499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:10:18.020033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:10:18.020603 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:10:18.033481 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:18.034223 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:18.035828 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:18.036495 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:18.058312 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Getting quotas for project 9452c1c2439d4247ad9a4e7e7f0ba486. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:10:18.064823 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Getting quotas for user 5afdfc7504694be8a8abc6fa07ed4e8f and project 9452c1c2439d4247ad9a4e7e7f0ba486. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:10:18.080098 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:10:18.082723 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:10:18.148785 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d6c907a5-1adf-4c0c-9ed7-afc20f81f0f4 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975962 May 25 17:10:18.149793 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 77/174] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:10:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:10:18.160564 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-60a6e6ea-88d3-454a-884c-0f2647b0eb0b tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:18.161190 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-60a6e6ea-88d3-454a-884c-0f2647b0eb0b tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:18.236894 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b4501920-b12b-4aae-b179-28d437f27708 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:18.244491 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-60a6e6ea-88d3-454a-884c-0f2647b0eb0b tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:18.252090 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b4501920-b12b-4aae-b179-28d437f27708 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.356101 May 25 17:10:18.254787 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-60a6e6ea-88d3-454a-884c-0f2647b0eb0b tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1214 microversion: 2.1 time: 0.098292 May 25 17:10:18.255979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 98/175] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:17 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:18.261319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 78/176] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:18 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:19.270748 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-59edb0a3-2509-4262-b958-67b0f89b1507 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:19.271887 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-59edb0a3-2509-4262-b958-67b0f89b1507 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:19.279010 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-59edb0a3-2509-4262-b958-67b0f89b1507 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:19.279369 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ca9a4e26-48a1-46fe-b4ed-ba5101f24e81 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:19.280119 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ca9a4e26-48a1-46fe-b4ed-ba5101f24e81 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:19.280232 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-59edb0a3-2509-4262-b958-67b0f89b1507 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:19.281150 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-59edb0a3-2509-4262-b958-67b0f89b1507 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:19.282454 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-59edb0a3-2509-4262-b958-67b0f89b1507 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:19.289658 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ca9a4e26-48a1-46fe-b4ed-ba5101f24e81 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:19.290525 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ca9a4e26-48a1-46fe-b4ed-ba5101f24e81 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:19.291424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ca9a4e26-48a1-46fe-b4ed-ba5101f24e81 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:19.292234 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ca9a4e26-48a1-46fe-b4ed-ba5101f24e81 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:19.364966 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ca9a4e26-48a1-46fe-b4ed-ba5101f24e81 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:19.389734 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ca9a4e26-48a1-46fe-b4ed-ba5101f24e81 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1266 microversion: 2.1 time: 0.119739 May 25 17:10:19.390440 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 79/177] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:19 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:19.534473 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-59edb0a3-2509-4262-b958-67b0f89b1507 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:19.545988 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-59edb0a3-2509-4262-b958-67b0f89b1507 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.278991 May 25 17:10:19.548734 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 99/178] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:19 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:20.409115 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4fb2eaf7-d74f-46c3-8c12-11fb1a7ebc97 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:20.410545 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4fb2eaf7-d74f-46c3-8c12-11fb1a7ebc97 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:20.422392 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fb2eaf7-d74f-46c3-8c12-11fb1a7ebc97 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:20.423276 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fb2eaf7-d74f-46c3-8c12-11fb1a7ebc97 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:20.424885 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fb2eaf7-d74f-46c3-8c12-11fb1a7ebc97 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:20.425514 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fb2eaf7-d74f-46c3-8c12-11fb1a7ebc97 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:20.565538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-33ab8d3d-3c52-4750-a6f1-1b73255e0458 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:20.566144 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-33ab8d3d-3c52-4750-a6f1-1b73255e0458 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:20.573285 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-33ab8d3d-3c52-4750-a6f1-1b73255e0458 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:20.588321 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-33ab8d3d-3c52-4750-a6f1-1b73255e0458 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:20.589805 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-33ab8d3d-3c52-4750-a6f1-1b73255e0458 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:20.590633 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-33ab8d3d-3c52-4750-a6f1-1b73255e0458 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:20.700376 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4fb2eaf7-d74f-46c3-8c12-11fb1a7ebc97 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:20.708528 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4fb2eaf7-d74f-46c3-8c12-11fb1a7ebc97 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.303591 May 25 17:10:20.710105 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 80/179] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:20 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:20.906149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-33ab8d3d-3c52-4750-a6f1-1b73255e0458 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:20.920433 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-33ab8d3d-3c52-4750-a6f1-1b73255e0458 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.359405 May 25 17:10:20.921268 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 100/180] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:20 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:21.290980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-a700872f-a58c-42f7-ae49-da95e771a156 req-735f440d-0499-4b8e-b512-a383006e130b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63976297-c3f2-47ae-a109-cd75b601bbeb", "tag": "758c3813-adb7-433a-b1e6-b2493af282a1"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:21.300973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-a700872f-a58c-42f7-ae49-da95e771a156 req-735f440d-0499-4b8e-b512-a383006e130b service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:21.301429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-a700872f-a58c-42f7-ae49-da95e771a156 req-735f440d-0499-4b8e-b512-a383006e130b service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:21.312958 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-a700872f-a58c-42f7-ae49-da95e771a156 req-735f440d-0499-4b8e-b512-a383006e130b service nova] Creating event network-changed:758c3813-adb7-433a-b1e6-b2493af282a1 for instance 63976297-c3f2-47ae-a109-cd75b601bbeb on hv-cinder-84330 May 25 17:10:21.318870 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-a700872f-a58c-42f7-ae49-da95e771a156 req-735f440d-0499-4b8e-b512-a383006e130b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031604 May 25 17:10:21.319786 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 81/181] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:10:21.726938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-bbea6ec1-9d93-463e-a5d5-1f197b49b244 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:21.727434 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-bbea6ec1-9d93-463e-a5d5-1f197b49b244 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:21.737232 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bbea6ec1-9d93-463e-a5d5-1f197b49b244 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:21.737746 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bbea6ec1-9d93-463e-a5d5-1f197b49b244 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:21.738728 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bbea6ec1-9d93-463e-a5d5-1f197b49b244 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:21.739183 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bbea6ec1-9d93-463e-a5d5-1f197b49b244 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:21.902864 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-bbea6ec1-9d93-463e-a5d5-1f197b49b244 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:21.911303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-bbea6ec1-9d93-463e-a5d5-1f197b49b244 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.188125 May 25 17:10:21.911975 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 101/182] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:21 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:21.944226 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e11a94bf-13e8-4795-a425-d397a9277da1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:21.945035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e11a94bf-13e8-4795-a425-d397a9277da1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:21.952063 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e11a94bf-13e8-4795-a425-d397a9277da1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:21.952488 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e11a94bf-13e8-4795-a425-d397a9277da1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:21.953367 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e11a94bf-13e8-4795-a425-d397a9277da1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:21.954460 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e11a94bf-13e8-4795-a425-d397a9277da1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:22.099760 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e11a94bf-13e8-4795-a425-d397a9277da1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:22.109516 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e11a94bf-13e8-4795-a425-d397a9277da1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.171810 May 25 17:10:22.111761 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 82/183] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:21 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:22.930234 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-60e675b3-d379-4bc2-a62f-36ebe2e04a9d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:22.931633 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-60e675b3-d379-4bc2-a62f-36ebe2e04a9d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:22.938072 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-60e675b3-d379-4bc2-a62f-36ebe2e04a9d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:22.939419 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-60e675b3-d379-4bc2-a62f-36ebe2e04a9d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:22.940351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-60e675b3-d379-4bc2-a62f-36ebe2e04a9d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:22.940825 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-60e675b3-d379-4bc2-a62f-36ebe2e04a9d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:23.128164 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b935e82d-0602-4244-b752-2afd78887a84 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:23.129462 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b935e82d-0602-4244-b752-2afd78887a84 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:23.136773 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b935e82d-0602-4244-b752-2afd78887a84 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:23.137494 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b935e82d-0602-4244-b752-2afd78887a84 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:23.138750 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b935e82d-0602-4244-b752-2afd78887a84 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:23.139349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b935e82d-0602-4244-b752-2afd78887a84 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:23.165262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-60e675b3-d379-4bc2-a62f-36ebe2e04a9d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:23.179319 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-60e675b3-d379-4bc2-a62f-36ebe2e04a9d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.252873 May 25 17:10:23.179841 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 102/184] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:22 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:23.295716 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b935e82d-0602-4244-b752-2afd78887a84 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:23.307163 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b935e82d-0602-4244-b752-2afd78887a84 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.183841 May 25 17:10:23.308401 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 83/185] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:23 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:24.197156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e9e79fbe-33ba-4b1c-b902-97d9ddffe884 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:24.197836 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e9e79fbe-33ba-4b1c-b902-97d9ddffe884 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:24.204070 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e9e79fbe-33ba-4b1c-b902-97d9ddffe884 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:24.204607 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e9e79fbe-33ba-4b1c-b902-97d9ddffe884 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:24.205557 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e9e79fbe-33ba-4b1c-b902-97d9ddffe884 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:24.206088 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e9e79fbe-33ba-4b1c-b902-97d9ddffe884 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:24.326063 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c6122e30-ca1a-43b2-af82-bb4a859ca759 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:24.326843 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c6122e30-ca1a-43b2-af82-bb4a859ca759 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:24.333658 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c6122e30-ca1a-43b2-af82-bb4a859ca759 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:24.334188 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c6122e30-ca1a-43b2-af82-bb4a859ca759 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:24.335119 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c6122e30-ca1a-43b2-af82-bb4a859ca759 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:24.335633 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c6122e30-ca1a-43b2-af82-bb4a859ca759 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:24.342045 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e9e79fbe-33ba-4b1c-b902-97d9ddffe884 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:24.350380 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e9e79fbe-33ba-4b1c-b902-97d9ddffe884 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.157036 May 25 17:10:24.350953 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 103/186] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:24 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:24.477091 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c6122e30-ca1a-43b2-af82-bb4a859ca759 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:24.484618 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c6122e30-ca1a-43b2-af82-bb4a859ca759 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.163234 May 25 17:10:24.485844 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 84/187] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:24 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:25.366175 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-eb333c76-2b7e-4a6e-a6fe-d986e700f45d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:25.366783 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-eb333c76-2b7e-4a6e-a6fe-d986e700f45d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:25.372875 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eb333c76-2b7e-4a6e-a6fe-d986e700f45d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:25.373393 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eb333c76-2b7e-4a6e-a6fe-d986e700f45d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:25.374147 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eb333c76-2b7e-4a6e-a6fe-d986e700f45d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:25.374578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eb333c76-2b7e-4a6e-a6fe-d986e700f45d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:25.503241 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e8e33bc4-e574-4471-84c7-5cc5a53f5c9d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:25.503859 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e8e33bc4-e574-4471-84c7-5cc5a53f5c9d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:25.511661 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8e33bc4-e574-4471-84c7-5cc5a53f5c9d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:25.512185 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8e33bc4-e574-4471-84c7-5cc5a53f5c9d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:25.513074 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8e33bc4-e574-4471-84c7-5cc5a53f5c9d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:25.513657 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8e33bc4-e574-4471-84c7-5cc5a53f5c9d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:25.518624 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-eb333c76-2b7e-4a6e-a6fe-d986e700f45d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:25.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-eb333c76-2b7e-4a6e-a6fe-d986e700f45d tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.164608 May 25 17:10:25.537998 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 104/188] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:25 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:25.653348 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e8e33bc4-e574-4471-84c7-5cc5a53f5c9d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:25.663511 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e8e33bc4-e574-4471-84c7-5cc5a53f5c9d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.165142 May 25 17:10:25.664283 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 85/189] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:25 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:26.545658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7dbb346e-071f-4b4d-9fc2-9dc877984ccb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:26.546290 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7dbb346e-071f-4b4d-9fc2-9dc877984ccb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:26.552998 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7dbb346e-071f-4b4d-9fc2-9dc877984ccb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:26.553468 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7dbb346e-071f-4b4d-9fc2-9dc877984ccb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:26.554210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7dbb346e-071f-4b4d-9fc2-9dc877984ccb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:26.554649 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7dbb346e-071f-4b4d-9fc2-9dc877984ccb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:26.693009 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7dbb346e-071f-4b4d-9fc2-9dc877984ccb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:26.693193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8ca4a053-7894-4b47-9589-1e066806d545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:26.693656 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8ca4a053-7894-4b47-9589-1e066806d545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:26.700499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ca4a053-7894-4b47-9589-1e066806d545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:26.701194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ca4a053-7894-4b47-9589-1e066806d545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:26.701727 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7dbb346e-071f-4b4d-9fc2-9dc877984ccb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.159797 May 25 17:10:26.702310 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ca4a053-7894-4b47-9589-1e066806d545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:26.702585 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 105/190] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:26 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:26.703054 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ca4a053-7894-4b47-9589-1e066806d545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:26.850056 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-279692fc-b0e3-49a3-a296-7ca7ec9bc4bf req-f7405465-8369-413a-a728-0a99be8cd197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63976297-c3f2-47ae-a109-cd75b601bbeb", "name": "network-vif-plugged", "status": "completed", "tag": "758c3813-adb7-433a-b1e6-b2493af282a1"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:26.861166 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-279692fc-b0e3-49a3-a296-7ca7ec9bc4bf req-f7405465-8369-413a-a728-0a99be8cd197 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:26.861754 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-279692fc-b0e3-49a3-a296-7ca7ec9bc4bf req-f7405465-8369-413a-a728-0a99be8cd197 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:26.874246 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-279692fc-b0e3-49a3-a296-7ca7ec9bc4bf req-f7405465-8369-413a-a728-0a99be8cd197 service nova] Creating event network-vif-plugged:758c3813-adb7-433a-b1e6-b2493af282a1 for instance 63976297-c3f2-47ae-a109-cd75b601bbeb on hv-cinder-84330 May 25 17:10:26.880437 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-279692fc-b0e3-49a3-a296-7ca7ec9bc4bf req-f7405465-8369-413a-a728-0a99be8cd197 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034154 May 25 17:10:26.881569 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 106/191] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:10:27.051738 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8ca4a053-7894-4b47-9589-1e066806d545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:27.059959 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8ca4a053-7894-4b47-9589-1e066806d545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.378699 May 25 17:10:27.060534 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 86/192] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:26 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:27.719570 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8f0ead0e-12d4-439b-a032-424680759e70 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:27.721364 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8f0ead0e-12d4-439b-a032-424680759e70 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:27.726747 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8f0ead0e-12d4-439b-a032-424680759e70 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:27.727196 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8f0ead0e-12d4-439b-a032-424680759e70 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:27.727955 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8f0ead0e-12d4-439b-a032-424680759e70 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:27.728384 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8f0ead0e-12d4-439b-a032-424680759e70 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:27.732730 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=100 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:27.878120 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8f0ead0e-12d4-439b-a032-424680759e70 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:27.887436 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8f0ead0e-12d4-439b-a032-424680759e70 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.171905 May 25 17:10:27.888011 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 107/193] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:27 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:28.077283 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e88b14df-957d-41f7-b1c7-13addbbb79a7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:28.077892 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e88b14df-957d-41f7-b1c7-13addbbb79a7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:28.081970 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:28.087651 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e88b14df-957d-41f7-b1c7-13addbbb79a7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:28.088109 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e88b14df-957d-41f7-b1c7-13addbbb79a7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:28.088968 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e88b14df-957d-41f7-b1c7-13addbbb79a7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:28.089409 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e88b14df-957d-41f7-b1c7-13addbbb79a7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:28.221003 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e88b14df-957d-41f7-b1c7-13addbbb79a7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:28.229026 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e88b14df-957d-41f7-b1c7-13addbbb79a7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.155753 May 25 17:10:28.229609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 87/194] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:28 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:28.904938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1bceaa5d-2faa-4f9f-a604-d17c683289c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:28.905572 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1bceaa5d-2faa-4f9f-a604-d17c683289c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:28.907572 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:28.914281 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1bceaa5d-2faa-4f9f-a604-d17c683289c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:28.914730 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1bceaa5d-2faa-4f9f-a604-d17c683289c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:28.915548 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1bceaa5d-2faa-4f9f-a604-d17c683289c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:28.915984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1bceaa5d-2faa-4f9f-a604-d17c683289c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:29.052984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1bceaa5d-2faa-4f9f-a604-d17c683289c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:29.061584 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1bceaa5d-2faa-4f9f-a604-d17c683289c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.160446 May 25 17:10:29.062477 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 108/195] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:28 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:29.246615 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-694fa9c6-9341-4803-9c84-3f41b36d5fd5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:29.247335 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-694fa9c6-9341-4803-9c84-3f41b36d5fd5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:29.249550 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=8 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:29.256331 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-694fa9c6-9341-4803-9c84-3f41b36d5fd5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:29.256811 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-694fa9c6-9341-4803-9c84-3f41b36d5fd5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:29.257602 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-694fa9c6-9341-4803-9c84-3f41b36d5fd5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:29.258041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-694fa9c6-9341-4803-9c84-3f41b36d5fd5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:29.428485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-694fa9c6-9341-4803-9c84-3f41b36d5fd5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:29.436249 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-694fa9c6-9341-4803-9c84-3f41b36d5fd5 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.193800 May 25 17:10:29.436933 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 88/196] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:29 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:30.079582 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2cc24269-198e-4e10-8b80-254bf5dcec82 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:30.080226 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2cc24269-198e-4e10-8b80-254bf5dcec82 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:30.086309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2cc24269-198e-4e10-8b80-254bf5dcec82 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:30.086753 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2cc24269-198e-4e10-8b80-254bf5dcec82 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:30.087501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2cc24269-198e-4e10-8b80-254bf5dcec82 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:30.087930 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2cc24269-198e-4e10-8b80-254bf5dcec82 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:30.213049 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2cc24269-198e-4e10-8b80-254bf5dcec82 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:30.220410 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2cc24269-198e-4e10-8b80-254bf5dcec82 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1498 microversion: 2.1 time: 0.144697 May 25 17:10:30.221045 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 109/197] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:30 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:30.453992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-43c82dc7-d9fb-4085-8e04-4f83a09cf1ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:30.454670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-43c82dc7-d9fb-4085-8e04-4f83a09cf1ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:30.462093 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-43c82dc7-d9fb-4085-8e04-4f83a09cf1ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:30.462463 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-43c82dc7-d9fb-4085-8e04-4f83a09cf1ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:30.463226 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-43c82dc7-d9fb-4085-8e04-4f83a09cf1ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:30.463653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-43c82dc7-d9fb-4085-8e04-4f83a09cf1ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:30.605943 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-43c82dc7-d9fb-4085-8e04-4f83a09cf1ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:30.614489 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-43c82dc7-d9fb-4085-8e04-4f83a09cf1ff tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.164162 May 25 17:10:30.615005 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 89/198] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:30 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:30.700583 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-44d19307-da4c-419e-99ac-23c746c32878 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:30.701196 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-44d19307-da4c-419e-99ac-23c746c32878 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:30.711459 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44d19307-da4c-419e-99ac-23c746c32878 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:30.714385 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44d19307-da4c-419e-99ac-23c746c32878 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:30.715041 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44d19307-da4c-419e-99ac-23c746c32878 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:30.715491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44d19307-da4c-419e-99ac-23c746c32878 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:30.753944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-44d19307-da4c-419e-99ac-23c746c32878 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:10:30.847063 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-44d19307-da4c-419e-99ac-23c746c32878 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "DELETE /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 204 len: 0 microversion: 2.1 time: 0.150371 May 25 17:10:30.851066 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 110/199] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:10:30 2022] DELETE /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:10:30.855779 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-af45df7c-840f-4af6-b060-9e769810f1ce tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:30.856438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-af45df7c-840f-4af6-b060-9e769810f1ce tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:30.863720 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af45df7c-840f-4af6-b060-9e769810f1ce tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:30.864175 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af45df7c-840f-4af6-b060-9e769810f1ce tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:30.865025 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af45df7c-840f-4af6-b060-9e769810f1ce tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:30.865402 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af45df7c-840f-4af6-b060-9e769810f1ce tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:31.006830 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-af45df7c-840f-4af6-b060-9e769810f1ce tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:31.014908 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-af45df7c-840f-4af6-b060-9e769810f1ce tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1504 microversion: 2.1 time: 0.162981 May 25 17:10:31.015489 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 90/200] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:30 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:31.632997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f05768f3-7f21-4384-98bc-0df41843ae5e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:31.633696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f05768f3-7f21-4384-98bc-0df41843ae5e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:31.639762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f05768f3-7f21-4384-98bc-0df41843ae5e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:31.640215 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f05768f3-7f21-4384-98bc-0df41843ae5e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:31.641015 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f05768f3-7f21-4384-98bc-0df41843ae5e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:31.641459 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f05768f3-7f21-4384-98bc-0df41843ae5e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:31.775544 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f05768f3-7f21-4384-98bc-0df41843ae5e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:31.783111 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f05768f3-7f21-4384-98bc-0df41843ae5e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.154510 May 25 17:10:31.783686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 111/201] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:31 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:32.033371 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-702e8a8a-c934-44fd-9e88-501d0c0dc766 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:32.033988 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-702e8a8a-c934-44fd-9e88-501d0c0dc766 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:32.040509 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-702e8a8a-c934-44fd-9e88-501d0c0dc766 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:32.041004 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-702e8a8a-c934-44fd-9e88-501d0c0dc766 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:32.041769 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-702e8a8a-c934-44fd-9e88-501d0c0dc766 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:32.042205 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-702e8a8a-c934-44fd-9e88-501d0c0dc766 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:32.178091 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-702e8a8a-c934-44fd-9e88-501d0c0dc766 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:32.185729 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-702e8a8a-c934-44fd-9e88-501d0c0dc766 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1504 microversion: 2.1 time: 0.156761 May 25 17:10:32.186318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 91/202] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:32 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:32.799872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e3e8e3e3-b1f0-48d5-9ad4-6ef38fbca389 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:32.800476 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e3e8e3e3-b1f0-48d5-9ad4-6ef38fbca389 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:32.807080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e3e8e3e3-b1f0-48d5-9ad4-6ef38fbca389 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:32.807527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e3e8e3e3-b1f0-48d5-9ad4-6ef38fbca389 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:32.808283 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e3e8e3e3-b1f0-48d5-9ad4-6ef38fbca389 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:32.808733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e3e8e3e3-b1f0-48d5-9ad4-6ef38fbca389 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:33.133791 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e3e8e3e3-b1f0-48d5-9ad4-6ef38fbca389 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:33.148743 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e3e8e3e3-b1f0-48d5-9ad4-6ef38fbca389 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.352926 May 25 17:10:33.160576 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 112/203] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:32 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:33.207103 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-98dd3fec-90cb-4b44-b8a7-962a871d1e24 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:33.208486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-98dd3fec-90cb-4b44-b8a7-962a871d1e24 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:33.212512 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:33.219229 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-98dd3fec-90cb-4b44-b8a7-962a871d1e24 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:33.219875 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-98dd3fec-90cb-4b44-b8a7-962a871d1e24 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:33.221696 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-98dd3fec-90cb-4b44-b8a7-962a871d1e24 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:33.223174 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-98dd3fec-90cb-4b44-b8a7-962a871d1e24 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:33.376028 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-98dd3fec-90cb-4b44-b8a7-962a871d1e24 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:33.385061 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-98dd3fec-90cb-4b44-b8a7-962a871d1e24 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 200 len: 1504 microversion: 2.1 time: 0.185280 May 25 17:10:33.385657 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 92/204] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:33 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:33.685628 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-d8654e9e-b78f-4bab-a7c1-a146dd69a513 req-8653ca44-18dc-484e-b556-612989339188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63976297-c3f2-47ae-a109-cd75b601bbeb", "name": "network-vif-deleted", "tag": "758c3813-adb7-433a-b1e6-b2493af282a1"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:33.697661 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-d8654e9e-b78f-4bab-a7c1-a146dd69a513 req-8653ca44-18dc-484e-b556-612989339188 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:33.698113 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-d8654e9e-b78f-4bab-a7c1-a146dd69a513 req-8653ca44-18dc-484e-b556-612989339188 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:33.711573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-d8654e9e-b78f-4bab-a7c1-a146dd69a513 req-8653ca44-18dc-484e-b556-612989339188 service nova] Creating event network-vif-deleted:758c3813-adb7-433a-b1e6-b2493af282a1 for instance 63976297-c3f2-47ae-a109-cd75b601bbeb on hv-cinder-84330 May 25 17:10:33.717426 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-d8654e9e-b78f-4bab-a7c1-a146dd69a513 req-8653ca44-18dc-484e-b556-612989339188 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038360 May 25 17:10:33.718141 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 113/205] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:10:34.168042 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fadb82bd-7758-42c0-a933-5409fd4e9d1f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:34.169057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fadb82bd-7758-42c0-a933-5409fd4e9d1f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:34.175818 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fadb82bd-7758-42c0-a933-5409fd4e9d1f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:34.176377 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fadb82bd-7758-42c0-a933-5409fd4e9d1f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:34.177137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fadb82bd-7758-42c0-a933-5409fd4e9d1f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:34.177604 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fadb82bd-7758-42c0-a933-5409fd4e9d1f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:34.375849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fadb82bd-7758-42c0-a933-5409fd4e9d1f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:34.379528 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:34.386845 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fadb82bd-7758-42c0-a933-5409fd4e9d1f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.223668 May 25 17:10:34.387528 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 93/206] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:34 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:34.404013 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6eeda76c-5b0d-4568-96e8-d9943ffe1958 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:34.404738 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6eeda76c-5b0d-4568-96e8-d9943ffe1958 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 63976297-c3f2-47ae-a109-cd75b601bbeb] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:34.410976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6eeda76c-5b0d-4568-96e8-d9943ffe1958 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:34.411521 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6eeda76c-5b0d-4568-96e8-d9943ffe1958 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:34.412164 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6eeda76c-5b0d-4568-96e8-d9943ffe1958 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:34.412593 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6eeda76c-5b0d-4568-96e8-d9943ffe1958 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:34.427107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-6eeda76c-5b0d-4568-96e8-d9943ffe1958 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] HTTP exception thrown: Instance 63976297-c3f2-47ae-a109-cd75b601bbeb could not be found. May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6eeda76c-5b0d-4568-96e8-d9943ffe1958 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Request method failure captured: May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb HTTP/1.1 May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmL2cCqBhKM-dZzTs43TnMT3oM_cDY5P2zz2fgj0qaLIEvDcANfwdh6XN4tIxHbDXHQtgBeefH598wJYdE4RPMvCEjf5iYLcpi7s79AIoyYbzPlCdjNL8KUfUZHl9qDrydz3ekWpGJ3Ne8wGabKrfDXBcpGwgNnCfvaYexnYBhJnJz8 May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 9452c1c2439d4247ad9a4e7e7f0ba486 May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-VolumesActionsTest-1654251659 May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:10:34.428773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_9452c1c2439d4247ad9a4e7e7f0ba486"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/9452c1c2439d4247ad9a4e7e7f0ba486"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/9452c1c2439d4247ad9a4e7e7f0ba486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/9452c1c2439d4247ad9a4e7e7f0ba486"}]}] May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-VolumesActionsTest-1654251659 May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 9452c1c2439d4247ad9a4e7e7f0ba486 May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-VolumesActionsTest-1654251659 May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-VolumesActionsTest-1654251659-project May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 5afdfc7504694be8a8abc6fa07ed4e8f May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-VolumesActionsTest-1654251659-project May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 63976297-c3f2-47ae-a109-cd75b601bbeb could not be found. May 25 17:10:34.430057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '63976297-c3f2-47ae-a109-cd75b601bbeb'} May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63976297-c3f2-47ae-a109-cd75b601bbeb could not be found. May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:10:34.430867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63976297-c3f2-47ae-a109-cd75b601bbeb could not be found. May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63976297-c3f2-47ae-a109-cd75b601bbeb could not be found. May 25 17:10:34.432566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:10:34.433928 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6eeda76c-5b0d-4568-96e8-d9943ffe1958 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Returning 404 to user: Instance 63976297-c3f2-47ae-a109-cd75b601bbeb could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:10:34.433928 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6eeda76c-5b0d-4568-96e8-d9943ffe1958 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb" status: 404 len: 111 microversion: 2.1 time: 0.030782 May 25 17:10:34.441545 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 114/207] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:34 2022] GET /compute/v2.1/servers/63976297-c3f2-47ae-a109-cd75b601bbeb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:10:34.566247 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2092602724", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "networks": [{"uuid": "f275f7e0-7ca7-4997-ab2c-da8062808dee"}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:34.628043 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] validate_networks() for [('f275f7e0-7ca7-4997-ab2c-da8062808dee', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:10:35.019230 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:10:35.019658 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:10:35.020137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:10:35.020551 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:10:35.025683 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:10:35.036828 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:35.037689 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:35.038759 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:35.038993 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:35.058743 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Getting quotas for project 9452c1c2439d4247ad9a4e7e7f0ba486. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:10:35.063336 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Getting quotas for user 5afdfc7504694be8a8abc6fa07ed4e8f and project 9452c1c2439d4247ad9a4e7e7f0ba486. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:10:35.077282 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:10:35.080186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:10:35.129051 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0e2ff33a-ce3c-4d7c-b497-8fee9f083ed7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568446 May 25 17:10:35.129819 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 94/208] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:10:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:10:35.139530 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4a6688c1-c4c0-4527-bad6-e28a2029a60a tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:35.140192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4a6688c1-c4c0-4527-bad6-e28a2029a60a tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:35.219843 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4a6688c1-c4c0-4527-bad6-e28a2029a60a tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:35.224829 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4a6688c1-c4c0-4527-bad6-e28a2029a60a tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1214 microversion: 2.1 time: 0.089037 May 25 17:10:35.225412 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 115/209] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:35 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:35.409952 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-744132dc-e372-4f1c-a343-ca72d97f119e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:35.410663 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-744132dc-e372-4f1c-a343-ca72d97f119e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:35.421341 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-744132dc-e372-4f1c-a343-ca72d97f119e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:35.421801 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-744132dc-e372-4f1c-a343-ca72d97f119e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:35.422750 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-744132dc-e372-4f1c-a343-ca72d97f119e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:35.423238 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-744132dc-e372-4f1c-a343-ca72d97f119e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:35.578763 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-744132dc-e372-4f1c-a343-ca72d97f119e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:35.591282 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-744132dc-e372-4f1c-a343-ca72d97f119e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.191427 May 25 17:10:35.591968 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 95/210] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:35 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:36.243289 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1238f72c-ddfa-4072-8965-11dcf1b0bec6 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:36.243889 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1238f72c-ddfa-4072-8965-11dcf1b0bec6 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:36.252053 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1238f72c-ddfa-4072-8965-11dcf1b0bec6 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:36.252600 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1238f72c-ddfa-4072-8965-11dcf1b0bec6 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:36.253401 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1238f72c-ddfa-4072-8965-11dcf1b0bec6 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:36.254540 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1238f72c-ddfa-4072-8965-11dcf1b0bec6 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:36.336660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1238f72c-ddfa-4072-8965-11dcf1b0bec6 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:36.346960 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1238f72c-ddfa-4072-8965-11dcf1b0bec6 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1284 microversion: 2.1 time: 0.107219 May 25 17:10:36.348372 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 116/211] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:36 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:36.615835 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9345c97b-fe31-44dc-a8dc-e7af94bf0aeb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:36.616792 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9345c97b-fe31-44dc-a8dc-e7af94bf0aeb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:36.626727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9345c97b-fe31-44dc-a8dc-e7af94bf0aeb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:36.627630 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9345c97b-fe31-44dc-a8dc-e7af94bf0aeb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:36.628613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9345c97b-fe31-44dc-a8dc-e7af94bf0aeb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:36.629173 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9345c97b-fe31-44dc-a8dc-e7af94bf0aeb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:36.823028 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9345c97b-fe31-44dc-a8dc-e7af94bf0aeb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:36.832385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9345c97b-fe31-44dc-a8dc-e7af94bf0aeb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.227418 May 25 17:10:36.833261 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 96/212] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:36 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:37.365699 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e77a5fe4-5fe8-431b-ba71-795623be7990 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:37.366402 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e77a5fe4-5fe8-431b-ba71-795623be7990 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:37.372732 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e77a5fe4-5fe8-431b-ba71-795623be7990 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:37.373278 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e77a5fe4-5fe8-431b-ba71-795623be7990 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:37.374124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e77a5fe4-5fe8-431b-ba71-795623be7990 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:37.374795 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e77a5fe4-5fe8-431b-ba71-795623be7990 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:37.651281 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e77a5fe4-5fe8-431b-ba71-795623be7990 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:37.658538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e77a5fe4-5fe8-431b-ba71-795623be7990 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1314 microversion: 2.1 time: 0.296664 May 25 17:10:37.659097 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 117/213] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:37 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:37.849925 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f09d52ed-87fe-42c5-ab2b-8b6ca85f71cc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:37.850964 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f09d52ed-87fe-42c5-ab2b-8b6ca85f71cc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:37.857241 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f09d52ed-87fe-42c5-ab2b-8b6ca85f71cc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:37.857685 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f09d52ed-87fe-42c5-ab2b-8b6ca85f71cc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:37.859039 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f09d52ed-87fe-42c5-ab2b-8b6ca85f71cc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:37.861951 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f09d52ed-87fe-42c5-ab2b-8b6ca85f71cc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:38.028975 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-ac600740-bc9a-4195-8c64-667672573d56 req-7df71e3b-1ecf-474f-8783-59b780e9c153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840abca2-d414-4f2f-ac80-65e4f4b0f3e9", "tag": "c2d167c9-899c-45c0-8b50-918a9ee2916f"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:38.030559 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f09d52ed-87fe-42c5-ab2b-8b6ca85f71cc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:38.041301 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f09d52ed-87fe-42c5-ab2b-8b6ca85f71cc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.195058 May 25 17:10:38.042431 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 97/214] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:37 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:38.056646 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-ac600740-bc9a-4195-8c64-667672573d56 req-7df71e3b-1ecf-474f-8783-59b780e9c153 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:38.057146 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-ac600740-bc9a-4195-8c64-667672573d56 req-7df71e3b-1ecf-474f-8783-59b780e9c153 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:38.078622 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-ac600740-bc9a-4195-8c64-667672573d56 req-7df71e3b-1ecf-474f-8783-59b780e9c153 service nova] Creating event network-changed:c2d167c9-899c-45c0-8b50-918a9ee2916f for instance 840abca2-d414-4f2f-ac80-65e4f4b0f3e9 on hv-cinder-84330 May 25 17:10:38.084876 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-ac600740-bc9a-4195-8c64-667672573d56 req-7df71e3b-1ecf-474f-8783-59b780e9c153 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064019 May 25 17:10:38.085722 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 118/215] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:10:38.676764 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cbddea50-bd19-46dc-98f1-cf73b575d2f7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:38.677677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cbddea50-bd19-46dc-98f1-cf73b575d2f7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:38.685050 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cbddea50-bd19-46dc-98f1-cf73b575d2f7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:38.685505 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cbddea50-bd19-46dc-98f1-cf73b575d2f7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:38.686280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cbddea50-bd19-46dc-98f1-cf73b575d2f7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:38.686904 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cbddea50-bd19-46dc-98f1-cf73b575d2f7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:38.823033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cbddea50-bd19-46dc-98f1-cf73b575d2f7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:38.831496 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cbddea50-bd19-46dc-98f1-cf73b575d2f7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1314 microversion: 2.1 time: 0.159058 May 25 17:10:38.832080 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 98/216] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:38 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:39.058557 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-67ac8c64-ed1e-4230-8911-c5ea37daa216 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:39.059234 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-67ac8c64-ed1e-4230-8911-c5ea37daa216 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:39.066339 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-67ac8c64-ed1e-4230-8911-c5ea37daa216 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:39.066783 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-67ac8c64-ed1e-4230-8911-c5ea37daa216 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:39.067591 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-67ac8c64-ed1e-4230-8911-c5ea37daa216 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:39.068027 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-67ac8c64-ed1e-4230-8911-c5ea37daa216 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:39.287666 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-67ac8c64-ed1e-4230-8911-c5ea37daa216 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:39.295507 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-67ac8c64-ed1e-4230-8911-c5ea37daa216 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.241098 May 25 17:10:39.296284 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 119/217] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:39 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:39.849973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1539fba3-b196-4d9b-9bb5-22a39e01733e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:39.850584 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1539fba3-b196-4d9b-9bb5-22a39e01733e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:39.859901 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1539fba3-b196-4d9b-9bb5-22a39e01733e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:39.860750 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1539fba3-b196-4d9b-9bb5-22a39e01733e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:39.862149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1539fba3-b196-4d9b-9bb5-22a39e01733e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:39.862915 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1539fba3-b196-4d9b-9bb5-22a39e01733e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:40.000071 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1539fba3-b196-4d9b-9bb5-22a39e01733e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:40.008539 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1539fba3-b196-4d9b-9bb5-22a39e01733e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1314 microversion: 2.1 time: 0.163791 May 25 17:10:40.009183 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 99/218] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:39 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:40.312942 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c5ad6d39-df2a-4fe0-be98-dbb0c99f5f53 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:40.315411 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c5ad6d39-df2a-4fe0-be98-dbb0c99f5f53 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:40.321733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5ad6d39-df2a-4fe0-be98-dbb0c99f5f53 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:40.322194 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5ad6d39-df2a-4fe0-be98-dbb0c99f5f53 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:40.322964 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5ad6d39-df2a-4fe0-be98-dbb0c99f5f53 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:40.323403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5ad6d39-df2a-4fe0-be98-dbb0c99f5f53 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:40.456031 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c5ad6d39-df2a-4fe0-be98-dbb0c99f5f53 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:40.463432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c5ad6d39-df2a-4fe0-be98-dbb0c99f5f53 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.154503 May 25 17:10:40.463991 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 120/219] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:40 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:41.026345 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f56dc53a-f553-47b6-825b-7c90e7235482 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:41.027049 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f56dc53a-f553-47b6-825b-7c90e7235482 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:41.039790 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f56dc53a-f553-47b6-825b-7c90e7235482 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:41.040415 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f56dc53a-f553-47b6-825b-7c90e7235482 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:41.041253 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f56dc53a-f553-47b6-825b-7c90e7235482 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:41.041696 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f56dc53a-f553-47b6-825b-7c90e7235482 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:41.176894 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f56dc53a-f553-47b6-825b-7c90e7235482 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:41.184802 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f56dc53a-f553-47b6-825b-7c90e7235482 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1314 microversion: 2.1 time: 0.162318 May 25 17:10:41.185371 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 100/220] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:41 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:41.479919 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-bf51eab9-ae34-44ee-bad5-76d90f4d4884 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:41.480443 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-bf51eab9-ae34-44ee-bad5-76d90f4d4884 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:41.487754 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bf51eab9-ae34-44ee-bad5-76d90f4d4884 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:41.488205 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bf51eab9-ae34-44ee-bad5-76d90f4d4884 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:41.489007 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bf51eab9-ae34-44ee-bad5-76d90f4d4884 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:41.489445 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bf51eab9-ae34-44ee-bad5-76d90f4d4884 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:41.621392 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-bf51eab9-ae34-44ee-bad5-76d90f4d4884 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:41.628893 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-bf51eab9-ae34-44ee-bad5-76d90f4d4884 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.152886 May 25 17:10:41.629464 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 121/221] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:41 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:42.202041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5cf2a487-7e14-440e-9491-24a2f5311d07 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:42.202792 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5cf2a487-7e14-440e-9491-24a2f5311d07 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:42.210977 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5cf2a487-7e14-440e-9491-24a2f5311d07 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:42.211246 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5cf2a487-7e14-440e-9491-24a2f5311d07 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:42.212017 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5cf2a487-7e14-440e-9491-24a2f5311d07 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:42.212487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5cf2a487-7e14-440e-9491-24a2f5311d07 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:42.363812 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5cf2a487-7e14-440e-9491-24a2f5311d07 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:42.384248 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5cf2a487-7e14-440e-9491-24a2f5311d07 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1314 microversion: 2.1 time: 0.185748 May 25 17:10:42.385511 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 101/222] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:42 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:42.646459 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-df6fee7e-7796-4e8e-85cc-9a7dec549fd7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:42.647070 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-df6fee7e-7796-4e8e-85cc-9a7dec549fd7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:42.653583 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df6fee7e-7796-4e8e-85cc-9a7dec549fd7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:42.654028 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df6fee7e-7796-4e8e-85cc-9a7dec549fd7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:42.654790 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df6fee7e-7796-4e8e-85cc-9a7dec549fd7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:42.655262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df6fee7e-7796-4e8e-85cc-9a7dec549fd7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:42.835076 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-df6fee7e-7796-4e8e-85cc-9a7dec549fd7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:42.843208 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-df6fee7e-7796-4e8e-85cc-9a7dec549fd7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.201151 May 25 17:10:42.848791 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 122/223] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:42 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:43.402082 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4a2fc4b0-ae07-4f8e-8fb6-0f74fc8cba95 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:43.402698 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4a2fc4b0-ae07-4f8e-8fb6-0f74fc8cba95 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:43.410672 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a2fc4b0-ae07-4f8e-8fb6-0f74fc8cba95 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:43.411129 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a2fc4b0-ae07-4f8e-8fb6-0f74fc8cba95 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:43.411907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a2fc4b0-ae07-4f8e-8fb6-0f74fc8cba95 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:43.412343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a2fc4b0-ae07-4f8e-8fb6-0f74fc8cba95 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:43.561955 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4a2fc4b0-ae07-4f8e-8fb6-0f74fc8cba95 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:43.571884 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4a2fc4b0-ae07-4f8e-8fb6-0f74fc8cba95 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1314 microversion: 2.1 time: 0.173561 May 25 17:10:43.572461 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 102/224] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:43 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:43.862013 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-219d17a3-4205-4b24-bc5b-747882a23de2 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:43.863187 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-219d17a3-4205-4b24-bc5b-747882a23de2 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:43.869830 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-219d17a3-4205-4b24-bc5b-747882a23de2 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:43.870481 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-219d17a3-4205-4b24-bc5b-747882a23de2 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:43.871249 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-219d17a3-4205-4b24-bc5b-747882a23de2 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:43.872055 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-219d17a3-4205-4b24-bc5b-747882a23de2 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:44.024592 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-219d17a3-4205-4b24-bc5b-747882a23de2 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:44.032192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-219d17a3-4205-4b24-bc5b-747882a23de2 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.174606 May 25 17:10:44.032992 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 123/225] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:43 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:44.589693 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-495b8ba0-8ac3-4d7f-8002-262525a730d3 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:44.590300 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-495b8ba0-8ac3-4d7f-8002-262525a730d3 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:44.597150 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-495b8ba0-8ac3-4d7f-8002-262525a730d3 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:44.597607 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-495b8ba0-8ac3-4d7f-8002-262525a730d3 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:44.598384 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-495b8ba0-8ac3-4d7f-8002-262525a730d3 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:44.598825 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-495b8ba0-8ac3-4d7f-8002-262525a730d3 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:44.735966 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-495b8ba0-8ac3-4d7f-8002-262525a730d3 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:44.743761 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-495b8ba0-8ac3-4d7f-8002-262525a730d3 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1314 microversion: 2.1 time: 0.158012 May 25 17:10:44.744332 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 103/226] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:44 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:44.937053 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-63a9a03c-6acd-4377-919d-8ce01a42639d req-5d56e624-a066-4431-9ae8-98824dc997b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840abca2-d414-4f2f-ac80-65e4f4b0f3e9", "name": "network-vif-plugged", "status": "completed", "tag": "c2d167c9-899c-45c0-8b50-918a9ee2916f"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:44.947354 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-63a9a03c-6acd-4377-919d-8ce01a42639d req-5d56e624-a066-4431-9ae8-98824dc997b3 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:44.947872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-63a9a03c-6acd-4377-919d-8ce01a42639d req-5d56e624-a066-4431-9ae8-98824dc997b3 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:44.960394 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-63a9a03c-6acd-4377-919d-8ce01a42639d req-5d56e624-a066-4431-9ae8-98824dc997b3 service nova] Creating event network-vif-plugged:c2d167c9-899c-45c0-8b50-918a9ee2916f for instance 840abca2-d414-4f2f-ac80-65e4f4b0f3e9 on hv-cinder-84330 May 25 17:10:44.965304 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-63a9a03c-6acd-4377-919d-8ce01a42639d req-5d56e624-a066-4431-9ae8-98824dc997b3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031971 May 25 17:10:44.965887 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 124/227] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:10:45.048980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-af5e6a0d-5d48-4e97-b7c5-bfe7159cf72c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:45.049598 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-af5e6a0d-5d48-4e97-b7c5-bfe7159cf72c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:45.051443 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:45.057119 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af5e6a0d-5d48-4e97-b7c5-bfe7159cf72c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:45.057576 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af5e6a0d-5d48-4e97-b7c5-bfe7159cf72c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:45.058347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af5e6a0d-5d48-4e97-b7c5-bfe7159cf72c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:45.058786 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af5e6a0d-5d48-4e97-b7c5-bfe7159cf72c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:45.074533 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:45.194373 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-af5e6a0d-5d48-4e97-b7c5-bfe7159cf72c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:45.201927 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-af5e6a0d-5d48-4e97-b7c5-bfe7159cf72c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1521 microversion: 2.1 time: 0.156923 May 25 17:10:45.202503 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 104/228] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:45 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:45.758652 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:45.762998 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0a57fd4c-e072-4923-b8b4-e8d64a3757d5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:45.763690 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0a57fd4c-e072-4923-b8b4-e8d64a3757d5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:45.771351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0a57fd4c-e072-4923-b8b4-e8d64a3757d5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:45.771799 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0a57fd4c-e072-4923-b8b4-e8d64a3757d5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:45.772553 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0a57fd4c-e072-4923-b8b4-e8d64a3757d5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:45.773015 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0a57fd4c-e072-4923-b8b4-e8d64a3757d5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:45.912375 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0a57fd4c-e072-4923-b8b4-e8d64a3757d5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:45.916575 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:45.922747 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0a57fd4c-e072-4923-b8b4-e8d64a3757d5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1314 microversion: 2.1 time: 0.164935 May 25 17:10:45.923353 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 125/229] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:45 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:46.219255 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e9128c30-3878-4be6-b8d6-97b2e74630a8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:46.220081 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e9128c30-3878-4be6-b8d6-97b2e74630a8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:46.226664 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e9128c30-3878-4be6-b8d6-97b2e74630a8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:46.227108 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e9128c30-3878-4be6-b8d6-97b2e74630a8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:46.227853 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e9128c30-3878-4be6-b8d6-97b2e74630a8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:46.228282 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e9128c30-3878-4be6-b8d6-97b2e74630a8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:46.365548 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e9128c30-3878-4be6-b8d6-97b2e74630a8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:46.373014 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e9128c30-3878-4be6-b8d6-97b2e74630a8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1501 microversion: 2.1 time: 0.157588 May 25 17:10:46.373588 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 105/230] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:46 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:46.390737 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4bfdd5eb-69b8-4d57-b98e-fe054ef026e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:46.391551 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4bfdd5eb-69b8-4d57-b98e-fe054ef026e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:46.399109 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4bfdd5eb-69b8-4d57-b98e-fe054ef026e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:46.399561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4bfdd5eb-69b8-4d57-b98e-fe054ef026e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:46.400368 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4bfdd5eb-69b8-4d57-b98e-fe054ef026e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:46.400824 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4bfdd5eb-69b8-4d57-b98e-fe054ef026e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:46.534574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4bfdd5eb-69b8-4d57-b98e-fe054ef026e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:46.542146 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4bfdd5eb-69b8-4d57-b98e-fe054ef026e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1516 microversion: 2.1 time: 0.156379 May 25 17:10:46.542796 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 126/231] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:46 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:46.939898 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ba7d84e2-cd34-4a8b-b1c6-ea0b79e6571e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:46.940437 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ba7d84e2-cd34-4a8b-b1c6-ea0b79e6571e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:46.946402 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba7d84e2-cd34-4a8b-b1c6-ea0b79e6571e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:46.946844 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba7d84e2-cd34-4a8b-b1c6-ea0b79e6571e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:46.947591 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba7d84e2-cd34-4a8b-b1c6-ea0b79e6571e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:46.948020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba7d84e2-cd34-4a8b-b1c6-ea0b79e6571e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:47.076135 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ba7d84e2-cd34-4a8b-b1c6-ea0b79e6571e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:47.084588 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ba7d84e2-cd34-4a8b-b1c6-ea0b79e6571e tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1314 microversion: 2.1 time: 0.149175 May 25 17:10:47.085203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 106/232] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:46 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:47.943401 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-47aa578a-8550-4cb8-8d5d-0d445254f141 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:47.944400 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-47aa578a-8550-4cb8-8d5d-0d445254f141 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:47.952373 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-47aa578a-8550-4cb8-8d5d-0d445254f141 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:47.953199 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-47aa578a-8550-4cb8-8d5d-0d445254f141 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:47.954706 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-47aa578a-8550-4cb8-8d5d-0d445254f141 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:47.955665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-47aa578a-8550-4cb8-8d5d-0d445254f141 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:47.981580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-47aa578a-8550-4cb8-8d5d-0d445254f141 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lazy-loading 'flavor' on Instance uuid 8f434295-7a0d-4d51-8f4e-6698b399b20a {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:10:48.067383 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-47aa578a-8550-4cb8-8d5d-0d445254f141 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a/action" status: 200 len: 32 microversion: 2.1 time: 0.128856 May 25 17:10:48.068224 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 127/233] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:10:47 2022] POST /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a/action => generated 32 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 17:10:48.077093 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2550f672-ed4b-45d1-a7a6-e2f3ae5737ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:48.077868 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2550f672-ed4b-45d1-a7a6-e2f3ae5737ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:48.085133 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2550f672-ed4b-45d1-a7a6-e2f3ae5737ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:48.085888 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2550f672-ed4b-45d1-a7a6-e2f3ae5737ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:48.087080 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2550f672-ed4b-45d1-a7a6-e2f3ae5737ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:48.087721 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2550f672-ed4b-45d1-a7a6-e2f3ae5737ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:48.104641 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-cb224d32-a501-4fd7-b156-dcd8a95129a7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:48.105635 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-cb224d32-a501-4fd7-b156-dcd8a95129a7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:48.112990 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cb224d32-a501-4fd7-b156-dcd8a95129a7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:48.114158 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cb224d32-a501-4fd7-b156-dcd8a95129a7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:48.115099 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cb224d32-a501-4fd7-b156-dcd8a95129a7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:48.115692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cb224d32-a501-4fd7-b156-dcd8a95129a7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:48.266914 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2550f672-ed4b-45d1-a7a6-e2f3ae5737ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:48.276535 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2550f672-ed4b-45d1-a7a6-e2f3ae5737ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.203229 May 25 17:10:48.277495 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 107/234] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:48 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:48.380954 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-cb224d32-a501-4fd7-b156-dcd8a95129a7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:48.388294 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-cb224d32-a501-4fd7-b156-dcd8a95129a7 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1498 microversion: 2.1 time: 0.287942 May 25 17:10:48.388911 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 128/235] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:48 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1498 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:48.968983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-04170cf6-8fe2-427f-aa0c-a7a6ab208307 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:48.970082 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-04170cf6-8fe2-427f-aa0c-a7a6ab208307 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:48.976433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04170cf6-8fe2-427f-aa0c-a7a6ab208307 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:48.976917 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04170cf6-8fe2-427f-aa0c-a7a6ab208307 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:48.978106 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04170cf6-8fe2-427f-aa0c-a7a6ab208307 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:48.978106 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04170cf6-8fe2-427f-aa0c-a7a6ab208307 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:49.006351 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-04170cf6-8fe2-427f-aa0c-a7a6ab208307 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:10:49.100956 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-04170cf6-8fe2-427f-aa0c-a7a6ab208307 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "DELETE /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 204 len: 0 microversion: 2.1 time: 0.134900 May 25 17:10:49.101531 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 108/236] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:10:48 2022] DELETE /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:10:49.111404 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-26d9cbd4-0ef0-4b81-ae31-b3cd0429eafb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:49.112859 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-26d9cbd4-0ef0-4b81-ae31-b3cd0429eafb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:49.119354 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-26d9cbd4-0ef0-4b81-ae31-b3cd0429eafb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:49.119822 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-26d9cbd4-0ef0-4b81-ae31-b3cd0429eafb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:49.120590 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-26d9cbd4-0ef0-4b81-ae31-b3cd0429eafb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:49.121055 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-26d9cbd4-0ef0-4b81-ae31-b3cd0429eafb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:49.252707 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-26d9cbd4-0ef0-4b81-ae31-b3cd0429eafb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:49.260591 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-26d9cbd4-0ef0-4b81-ae31-b3cd0429eafb tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1504 microversion: 2.1 time: 0.154679 May 25 17:10:49.261196 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 129/237] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:49 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:49.294118 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6393ac08-16a5-4809-a865-2ba485226fa4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:49.294849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6393ac08-16a5-4809-a865-2ba485226fa4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:49.302095 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6393ac08-16a5-4809-a865-2ba485226fa4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:49.302549 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6393ac08-16a5-4809-a865-2ba485226fa4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:49.303320 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6393ac08-16a5-4809-a865-2ba485226fa4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:49.303757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6393ac08-16a5-4809-a865-2ba485226fa4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:49.320341 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:49.476524 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6393ac08-16a5-4809-a865-2ba485226fa4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:49.484172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6393ac08-16a5-4809-a865-2ba485226fa4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.194176 May 25 17:10:49.495240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 109/238] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:49 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:50.279560 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d4cfee05-7c8c-4245-bf87-e01856d9d3b2 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:50.280212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d4cfee05-7c8c-4245-bf87-e01856d9d3b2 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:50.287046 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d4cfee05-7c8c-4245-bf87-e01856d9d3b2 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:50.287624 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d4cfee05-7c8c-4245-bf87-e01856d9d3b2 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:50.288400 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d4cfee05-7c8c-4245-bf87-e01856d9d3b2 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:50.288871 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d4cfee05-7c8c-4245-bf87-e01856d9d3b2 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:50.426477 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d4cfee05-7c8c-4245-bf87-e01856d9d3b2 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:50.434483 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d4cfee05-7c8c-4245-bf87-e01856d9d3b2 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1504 microversion: 2.1 time: 0.158721 May 25 17:10:50.435126 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 130/239] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:50 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:50.503752 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3a1cf675-10b3-4d71-addc-76d69bddf3fe tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:50.505030 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3a1cf675-10b3-4d71-addc-76d69bddf3fe tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:50.511524 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a1cf675-10b3-4d71-addc-76d69bddf3fe tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:50.511981 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a1cf675-10b3-4d71-addc-76d69bddf3fe tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:50.512784 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a1cf675-10b3-4d71-addc-76d69bddf3fe tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:50.513225 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a1cf675-10b3-4d71-addc-76d69bddf3fe tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:50.651273 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3a1cf675-10b3-4d71-addc-76d69bddf3fe tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:50.659773 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3a1cf675-10b3-4d71-addc-76d69bddf3fe tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.161097 May 25 17:10:50.660347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 110/240] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:50 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:51.446355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-c46e7638-6998-47c6-a9d6-eacf0f874c9a req-e088eaa3-7268-4193-89f3-e31da7c11454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840abca2-d414-4f2f-ac80-65e4f4b0f3e9", "name": "network-vif-deleted", "tag": "c2d167c9-899c-45c0-8b50-918a9ee2916f"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:10:51.456377 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-c46e7638-6998-47c6-a9d6-eacf0f874c9a req-e088eaa3-7268-4193-89f3-e31da7c11454 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:51.457063 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-c46e7638-6998-47c6-a9d6-eacf0f874c9a req-e088eaa3-7268-4193-89f3-e31da7c11454 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:51.459486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-09754e4a-55bc-4a75-94fb-754b3238c6c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:51.468860 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-c46e7638-6998-47c6-a9d6-eacf0f874c9a req-e088eaa3-7268-4193-89f3-e31da7c11454 service nova] Creating event network-vif-deleted:c2d167c9-899c-45c0-8b50-918a9ee2916f for instance 840abca2-d414-4f2f-ac80-65e4f4b0f3e9 on hv-cinder-84330 May 25 17:10:51.470525 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-09754e4a-55bc-4a75-94fb-754b3238c6c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:51.475145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-c46e7638-6998-47c6-a9d6-eacf0f874c9a req-e088eaa3-7268-4193-89f3-e31da7c11454 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 May 25 17:10:51.475800 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 131/241] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:10:51.490001 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09754e4a-55bc-4a75-94fb-754b3238c6c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:51.490551 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09754e4a-55bc-4a75-94fb-754b3238c6c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:51.492311 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09754e4a-55bc-4a75-94fb-754b3238c6c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:51.493058 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09754e4a-55bc-4a75-94fb-754b3238c6c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:51.580245 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-09754e4a-55bc-4a75-94fb-754b3238c6c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afdfc7504694be8a8abc6fa07ed4e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9452c1c2439d4247ad9a4e7e7f0ba486', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:51.587784 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-09754e4a-55bc-4a75-94fb-754b3238c6c5 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 200 len: 1299 microversion: 2.1 time: 0.135541 May 25 17:10:51.588366 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 111/242] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:51 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:10:51.677833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b5daa9d9-a248-4791-a4f8-912d7caa15bd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:51.679121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b5daa9d9-a248-4791-a4f8-912d7caa15bd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:51.687023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b5daa9d9-a248-4791-a4f8-912d7caa15bd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:51.687693 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b5daa9d9-a248-4791-a4f8-912d7caa15bd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:51.689014 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b5daa9d9-a248-4791-a4f8-912d7caa15bd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:51.689525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b5daa9d9-a248-4791-a4f8-912d7caa15bd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:51.848286 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b5daa9d9-a248-4791-a4f8-912d7caa15bd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:51.855787 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b5daa9d9-a248-4791-a4f8-912d7caa15bd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.182580 May 25 17:10:51.856547 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 132/243] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:51 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:52.606532 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-da96dd7d-148d-487b-b58b-8b4e3afa3496 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:52.607678 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-da96dd7d-148d-487b-b58b-8b4e3afa3496 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] [instance: 840abca2-d414-4f2f-ac80-65e4f4b0f3e9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:52.614532 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-da96dd7d-148d-487b-b58b-8b4e3afa3496 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:52.615067 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-da96dd7d-148d-487b-b58b-8b4e3afa3496 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:52.615908 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-da96dd7d-148d-487b-b58b-8b4e3afa3496 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:52.616440 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-da96dd7d-148d-487b-b58b-8b4e3afa3496 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:52.630678 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-da96dd7d-148d-487b-b58b-8b4e3afa3496 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] HTTP exception thrown: Instance 840abca2-d414-4f2f-ac80-65e4f4b0f3e9 could not be found. May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-da96dd7d-148d-487b-b58b-8b4e3afa3496 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Request method failure captured: May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 HTTP/1.1 May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmL2cCqBhKM-dZzTs43TnMT3oM_cDY5P2zz2fgj0qaLIEvDcANfwdh6XN4tIxHbDXHQtgBeefH598wJYdE4RPMvCEjf5iYLcpi7s79AIoyYbzPlCdjNL8KUfUZHl9qDrydz3ekWpGJ3Ne8wGabKrfDXBcpGwgNnCfvaYexnYBhJnJz8 May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 9452c1c2439d4247ad9a4e7e7f0ba486 May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesActionsTest-1654251659 May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:10:52.632347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_9452c1c2439d4247ad9a4e7e7f0ba486"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/9452c1c2439d4247ad9a4e7e7f0ba486"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/9452c1c2439d4247ad9a4e7e7f0ba486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/9452c1c2439d4247ad9a4e7e7f0ba486"}]}] May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesActionsTest-1654251659 May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 9452c1c2439d4247ad9a4e7e7f0ba486 May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesActionsTest-1654251659 May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesActionsTest-1654251659-project May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 5afdfc7504694be8a8abc6fa07ed4e8f May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesActionsTest-1654251659-project May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 840abca2-d414-4f2f-ac80-65e4f4b0f3e9 could not be found. May 25 17:10:52.633814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '840abca2-d414-4f2f-ac80-65e4f4b0f3e9'} May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840abca2-d414-4f2f-ac80-65e4f4b0f3e9 could not be found. May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:10:52.634677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840abca2-d414-4f2f-ac80-65e4f4b0f3e9 could not be found. May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840abca2-d414-4f2f-ac80-65e4f4b0f3e9 could not be found. May 25 17:10:52.636196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:10:52.637420 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-da96dd7d-148d-487b-b58b-8b4e3afa3496 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] Returning 404 to user: Instance 840abca2-d414-4f2f-ac80-65e4f4b0f3e9 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:10:52.637420 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-da96dd7d-148d-487b-b58b-8b4e3afa3496 tempest-VolumesActionsTest-1654251659 tempest-VolumesActionsTest-1654251659-project] 10.222.0.31 "GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9" status: 404 len: 111 microversion: 2.1 time: 0.031405 May 25 17:10:52.637420 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 112/244] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:52 2022] GET /compute/v2.1/servers/840abca2-d414-4f2f-ac80-65e4f4b0f3e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:10:52.874073 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ebef8c8c-f3b9-4a8d-8d12-12ff8d9376d7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:52.874712 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ebef8c8c-f3b9-4a8d-8d12-12ff8d9376d7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:52.884227 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ebef8c8c-f3b9-4a8d-8d12-12ff8d9376d7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:52.884841 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ebef8c8c-f3b9-4a8d-8d12-12ff8d9376d7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:52.886537 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ebef8c8c-f3b9-4a8d-8d12-12ff8d9376d7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:52.890032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ebef8c8c-f3b9-4a8d-8d12-12ff8d9376d7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:53.058879 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ebef8c8c-f3b9-4a8d-8d12-12ff8d9376d7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:53.067402 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ebef8c8c-f3b9-4a8d-8d12-12ff8d9376d7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.198725 May 25 17:10:53.068070 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 133/245] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:52 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:54.083617 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2895f247-f0cb-487e-a00d-0af9d0c8f97e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:54.084228 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2895f247-f0cb-487e-a00d-0af9d0c8f97e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:54.092714 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2895f247-f0cb-487e-a00d-0af9d0c8f97e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:54.092714 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2895f247-f0cb-487e-a00d-0af9d0c8f97e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:54.092714 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2895f247-f0cb-487e-a00d-0af9d0c8f97e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:54.092714 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2895f247-f0cb-487e-a00d-0af9d0c8f97e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:54.226552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2895f247-f0cb-487e-a00d-0af9d0c8f97e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:54.234303 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2895f247-f0cb-487e-a00d-0af9d0c8f97e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.154586 May 25 17:10:54.235461 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 113/246] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:54 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:55.251429 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-161b9695-27ad-48b2-b064-d779f178951f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:55.252042 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-161b9695-27ad-48b2-b064-d779f178951f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:55.258205 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-161b9695-27ad-48b2-b064-d779f178951f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:55.258656 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-161b9695-27ad-48b2-b064-d779f178951f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:55.259481 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-161b9695-27ad-48b2-b064-d779f178951f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:55.259926 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-161b9695-27ad-48b2-b064-d779f178951f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:55.403043 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-161b9695-27ad-48b2-b064-d779f178951f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:55.411254 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-161b9695-27ad-48b2-b064-d779f178951f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.163740 May 25 17:10:55.411828 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 134/247] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:55 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:56.429499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1f58ee9e-1c4d-4b14-95dd-4f497ff27545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:56.430114 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1f58ee9e-1c4d-4b14-95dd-4f497ff27545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:56.436667 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1f58ee9e-1c4d-4b14-95dd-4f497ff27545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:56.437146 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1f58ee9e-1c4d-4b14-95dd-4f497ff27545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:56.437967 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1f58ee9e-1c4d-4b14-95dd-4f497ff27545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:56.438662 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1f58ee9e-1c4d-4b14-95dd-4f497ff27545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:56.567668 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1f58ee9e-1c4d-4b14-95dd-4f497ff27545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:56.575333 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1f58ee9e-1c4d-4b14-95dd-4f497ff27545 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.149765 May 25 17:10:56.575892 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 114/248] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:56 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:57.592164 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-eeeaec75-5038-4dea-9b92-8d69e61f227c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:57.592812 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-eeeaec75-5038-4dea-9b92-8d69e61f227c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:57.598885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eeeaec75-5038-4dea-9b92-8d69e61f227c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:57.599403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eeeaec75-5038-4dea-9b92-8d69e61f227c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:57.600166 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eeeaec75-5038-4dea-9b92-8d69e61f227c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:57.600859 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eeeaec75-5038-4dea-9b92-8d69e61f227c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:57.756332 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-eeeaec75-5038-4dea-9b92-8d69e61f227c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:57.768282 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-eeeaec75-5038-4dea-9b92-8d69e61f227c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.179280 May 25 17:10:57.769741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 135/249] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:57 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:10:58.241442 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-57c74b7f-de45-48b9-b1e4-f653c5652bb2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:58.242030 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-57c74b7f-de45-48b9-b1e4-f653c5652bb2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:58.254925 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-57c74b7f-de45-48b9-b1e4-f653c5652bb2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:58.255626 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-57c74b7f-de45-48b9-b1e4-f653c5652bb2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:58.256568 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-57c74b7f-de45-48b9-b1e4-f653c5652bb2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:58.257195 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-57c74b7f-de45-48b9-b1e4-f653c5652bb2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:58.304893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-57c74b7f-de45-48b9-b1e4-f653c5652bb2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/ips" status: 200 len: 151 microversion: 2.20 time: 0.067572 May 25 17:10:58.305705 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 115/250] 10.222.0.31 () {60 vars in 1288 bytes} [Wed May 25 17:10:58 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/ips => generated 151 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:10:58.794107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-216d0e67-cec3-4aca-a287-ac7ac619616b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:10:58.796254 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-216d0e67-cec3-4aca-a287-ac7ac619616b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:10:58.803904 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-216d0e67-cec3-4aca-a287-ac7ac619616b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:58.804723 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-216d0e67-cec3-4aca-a287-ac7ac619616b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:58.806008 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-216d0e67-cec3-4aca-a287-ac7ac619616b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:10:58.807383 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-216d0e67-cec3-4aca-a287-ac7ac619616b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:10:58.994825 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-216d0e67-cec3-4aca-a287-ac7ac619616b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:10:59.006238 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-216d0e67-cec3-4aca-a287-ac7ac619616b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.217906 May 25 17:10:59.017818 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 136/251] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:10:58 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:00.032224 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-80d31703-2ffa-447c-ae29-8adbded9d885 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:00.034398 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-80d31703-2ffa-447c-ae29-8adbded9d885 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:00.041479 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80d31703-2ffa-447c-ae29-8adbded9d885 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:00.042155 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80d31703-2ffa-447c-ae29-8adbded9d885 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:00.043144 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80d31703-2ffa-447c-ae29-8adbded9d885 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:00.043574 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80d31703-2ffa-447c-ae29-8adbded9d885 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:00.230566 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-80d31703-2ffa-447c-ae29-8adbded9d885 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:00.242415 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-80d31703-2ffa-447c-ae29-8adbded9d885 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.222330 May 25 17:11:00.254810 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 116/252] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:00 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:00.865302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ac5aea46-a075-4d3d-a2fe-a1956fed8bcc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:00.866078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ac5aea46-a075-4d3d-a2fe-a1956fed8bcc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:00.867909 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:00.876762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ac5aea46-a075-4d3d-a2fe-a1956fed8bcc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:00.877657 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ac5aea46-a075-4d3d-a2fe-a1956fed8bcc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:00.878512 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ac5aea46-a075-4d3d-a2fe-a1956fed8bcc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:00.879166 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ac5aea46-a075-4d3d-a2fe-a1956fed8bcc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:00.905900 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ac5aea46-a075-4d3d-a2fe-a1956fed8bcc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/ips" status: 200 len: 143 microversion: 2.1 time: 0.044475 May 25 17:11:00.907519 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 137/253] 10.222.0.31 () {58 vars in 1247 bytes} [Wed May 25 17:11:00 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/ips => generated 143 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:01.260499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-53fa46dd-d72e-42a5-99cc-935373172454 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:01.261138 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-53fa46dd-d72e-42a5-99cc-935373172454 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:01.269519 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53fa46dd-d72e-42a5-99cc-935373172454 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:01.270277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53fa46dd-d72e-42a5-99cc-935373172454 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:01.271241 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53fa46dd-d72e-42a5-99cc-935373172454 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:01.271877 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53fa46dd-d72e-42a5-99cc-935373172454 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:01.435083 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-53fa46dd-d72e-42a5-99cc-935373172454 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:01.446132 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-53fa46dd-d72e-42a5-99cc-935373172454 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.189460 May 25 17:11:01.449669 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 117/254] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:01 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:02.465700 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-66be590d-26b0-4ab3-a104-edf4de1bda7a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:02.466307 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-66be590d-26b0-4ab3-a104-edf4de1bda7a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:02.473012 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-66be590d-26b0-4ab3-a104-edf4de1bda7a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:02.473462 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-66be590d-26b0-4ab3-a104-edf4de1bda7a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:02.474217 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-66be590d-26b0-4ab3-a104-edf4de1bda7a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:02.474656 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-66be590d-26b0-4ab3-a104-edf4de1bda7a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:02.604423 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-66be590d-26b0-4ab3-a104-edf4de1bda7a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:02.612869 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-66be590d-26b0-4ab3-a104-edf4de1bda7a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.150947 May 25 17:11:02.613436 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 138/255] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:02 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:03.631155 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d48c6150-29c3-4ae5-a965-49b79bfc0126 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:03.631911 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d48c6150-29c3-4ae5-a965-49b79bfc0126 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:03.634511 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:03.640163 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d48c6150-29c3-4ae5-a965-49b79bfc0126 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:03.640739 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d48c6150-29c3-4ae5-a965-49b79bfc0126 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:03.642100 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d48c6150-29c3-4ae5-a965-49b79bfc0126 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:03.642543 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d48c6150-29c3-4ae5-a965-49b79bfc0126 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:03.792602 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d48c6150-29c3-4ae5-a965-49b79bfc0126 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:03.801124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d48c6150-29c3-4ae5-a965-49b79bfc0126 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.173599 May 25 17:11:03.808390 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 118/256] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:03 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:04.820459 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6314ed96-8513-4244-9bc9-e1b1294b04e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:04.823152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6314ed96-8513-4244-9bc9-e1b1294b04e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:04.834549 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6314ed96-8513-4244-9bc9-e1b1294b04e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:04.835578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6314ed96-8513-4244-9bc9-e1b1294b04e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:04.836817 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6314ed96-8513-4244-9bc9-e1b1294b04e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:04.838011 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6314ed96-8513-4244-9bc9-e1b1294b04e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:04.933112 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b7d31c8e-65ed-4c9a-ac0e-ef19f957ba52 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:04.936208 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b7d31c8e-65ed-4c9a-ac0e-ef19f957ba52 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:04.949547 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b7d31c8e-65ed-4c9a-ac0e-ef19f957ba52 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:04.956312 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b7d31c8e-65ed-4c9a-ac0e-ef19f957ba52 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:04.957332 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b7d31c8e-65ed-4c9a-ac0e-ef19f957ba52 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:04.961113 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b7d31c8e-65ed-4c9a-ac0e-ef19f957ba52 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:05.017369 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-b7d31c8e-65ed-4c9a-ac0e-ef19f957ba52 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lazy-loading 'flavor' on Instance uuid c99e2d9c-ac45-4a8e-8076-faaf830c29e0 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:11:05.066260 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6314ed96-8513-4244-9bc9-e1b1294b04e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:05.079627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6314ed96-8513-4244-9bc9-e1b1294b04e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.264359 May 25 17:11:05.080853 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 139/257] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:04 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:05.520761 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b7d31c8e-65ed-4c9a-ac0e-ef19f957ba52 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "POST /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/action" status: 202 len: 0 microversion: 2.20 time: 0.591714 May 25 17:11:05.522143 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 119/258] 10.222.0.31 () {62 vars in 1318 bytes} [Wed May 25 17:11:04 2022] POST /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 25 17:11:05.541300 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c1204bbf-d173-47ca-9807-ad3885959e82 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:05.541910 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c1204bbf-d173-47ca-9807-ad3885959e82 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:05.557324 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c1204bbf-d173-47ca-9807-ad3885959e82 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:05.557882 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c1204bbf-d173-47ca-9807-ad3885959e82 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:05.558562 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c1204bbf-d173-47ca-9807-ad3885959e82 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:05.559005 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c1204bbf-d173-47ca-9807-ad3885959e82 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:05.751932 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c1204bbf-d173-47ca-9807-ad3885959e82 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:05.761974 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c1204bbf-d173-47ca-9807-ad3885959e82 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:05.763493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c1204bbf-d173-47ca-9807-ad3885959e82 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:05.764653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c1204bbf-d173-47ca-9807-ad3885959e82 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.235581 May 25 17:11:05.766129 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 140/259] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:05 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:06.099481 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c586d4f4-9677-4014-a837-dce7e22a926b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:06.100524 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c586d4f4-9677-4014-a837-dce7e22a926b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:06.107282 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c586d4f4-9677-4014-a837-dce7e22a926b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:06.107747 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c586d4f4-9677-4014-a837-dce7e22a926b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:06.108578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c586d4f4-9677-4014-a837-dce7e22a926b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:06.109091 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c586d4f4-9677-4014-a837-dce7e22a926b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:06.262115 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c586d4f4-9677-4014-a837-dce7e22a926b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:06.271143 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c586d4f4-9677-4014-a837-dce7e22a926b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.177330 May 25 17:11:06.271941 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 120/260] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:06 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:06.305024 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3e81ffdf-1516-435b-8ae8-a9ba3c05df2d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "265bf648-f2fd-41dd-aee8-b5517e9e9d1b"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:06.306149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3e81ffdf-1516-435b-8ae8-a9ba3c05df2d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:06.315678 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3e81ffdf-1516-435b-8ae8-a9ba3c05df2d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:06.316155 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3e81ffdf-1516-435b-8ae8-a9ba3c05df2d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:06.319163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3e81ffdf-1516-435b-8ae8-a9ba3c05df2d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:06.319163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3e81ffdf-1516-435b-8ae8-a9ba3c05df2d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:06.337935 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:06.789651 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f75d1a87-c8f2-4db7-9503-44b3b3302341 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:06.793359 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f75d1a87-c8f2-4db7-9503-44b3b3302341 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:06.807439 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f75d1a87-c8f2-4db7-9503-44b3b3302341 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:06.807891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f75d1a87-c8f2-4db7-9503-44b3b3302341 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:06.808671 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f75d1a87-c8f2-4db7-9503-44b3b3302341 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:06.815437 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f75d1a87-c8f2-4db7-9503-44b3b3302341 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:06.966949 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f75d1a87-c8f2-4db7-9503-44b3b3302341 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:06.976164 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f75d1a87-c8f2-4db7-9503-44b3b3302341 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:06.977696 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f75d1a87-c8f2-4db7-9503-44b3b3302341 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:06.978906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f75d1a87-c8f2-4db7-9503-44b3b3302341 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.199578 May 25 17:11:06.979687 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 121/261] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:06 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:07.288397 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-aaac6129-8988-4a91-a4cb-1bbc1bf1d37f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:07.289110 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-aaac6129-8988-4a91-a4cb-1bbc1bf1d37f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:07.295891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aaac6129-8988-4a91-a4cb-1bbc1bf1d37f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:07.296344 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aaac6129-8988-4a91-a4cb-1bbc1bf1d37f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:07.297188 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aaac6129-8988-4a91-a4cb-1bbc1bf1d37f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:07.297626 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aaac6129-8988-4a91-a4cb-1bbc1bf1d37f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:07.441480 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-aaac6129-8988-4a91-a4cb-1bbc1bf1d37f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:07.450010 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-aaac6129-8988-4a91-a4cb-1bbc1bf1d37f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.165396 May 25 17:11:07.450698 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 122/262] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:07 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:07.997780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-18a0a26f-e753-4b6e-8107-2947b69aca1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:07.998385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-18a0a26f-e753-4b6e-8107-2947b69aca1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:08.006842 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18a0a26f-e753-4b6e-8107-2947b69aca1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:08.007366 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18a0a26f-e753-4b6e-8107-2947b69aca1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:08.008249 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18a0a26f-e753-4b6e-8107-2947b69aca1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:08.008610 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18a0a26f-e753-4b6e-8107-2947b69aca1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:08.170480 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-18a0a26f-e753-4b6e-8107-2947b69aca1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:08.179646 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-18a0a26f-e753-4b6e-8107-2947b69aca1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:08.181204 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-18a0a26f-e753-4b6e-8107-2947b69aca1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:08.182379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-18a0a26f-e753-4b6e-8107-2947b69aca1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.188469 May 25 17:11:08.183130 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 123/263] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:07 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:08.467430 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-65de6437-bc30-4e3a-afed-f8d6753730ce tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:08.468223 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-65de6437-bc30-4e3a-afed-f8d6753730ce tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:08.475220 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65de6437-bc30-4e3a-afed-f8d6753730ce tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:08.475760 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65de6437-bc30-4e3a-afed-f8d6753730ce tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:08.476625 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65de6437-bc30-4e3a-afed-f8d6753730ce tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:08.477170 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65de6437-bc30-4e3a-afed-f8d6753730ce tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:08.654700 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-65de6437-bc30-4e3a-afed-f8d6753730ce tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:08.667575 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-65de6437-bc30-4e3a-afed-f8d6753730ce tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.203553 May 25 17:11:08.668884 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 124/264] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:08 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:08.906227 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3e81ffdf-1516-435b-8ae8-a9ba3c05df2d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.604739 May 25 17:11:08.932931 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 141/265] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:11:06 2022] POST /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/os-volume_attachments => generated 194 bytes in 2632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:09.201503 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-49ea9d5f-3cc1-4f2a-ac2c-5a92fab24673 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:09.201973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-49ea9d5f-3cc1-4f2a-ac2c-5a92fab24673 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:09.214796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-49ea9d5f-3cc1-4f2a-ac2c-5a92fab24673 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:09.215515 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-49ea9d5f-3cc1-4f2a-ac2c-5a92fab24673 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:09.218852 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-49ea9d5f-3cc1-4f2a-ac2c-5a92fab24673 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:09.220139 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-49ea9d5f-3cc1-4f2a-ac2c-5a92fab24673 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:09.257094 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:09.388306 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-49ea9d5f-3cc1-4f2a-ac2c-5a92fab24673 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:09.400415 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-49ea9d5f-3cc1-4f2a-ac2c-5a92fab24673 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:09.402310 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-49ea9d5f-3cc1-4f2a-ac2c-5a92fab24673 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:09.403764 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-49ea9d5f-3cc1-4f2a-ac2c-5a92fab24673 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.206971 May 25 17:11:09.404948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 125/266] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:09 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:09.692508 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6714a2cd-94f9-41ae-a2b9-245a2a8b48c6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:09.693233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6714a2cd-94f9-41ae-a2b9-245a2a8b48c6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:09.708271 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6714a2cd-94f9-41ae-a2b9-245a2a8b48c6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:09.708748 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6714a2cd-94f9-41ae-a2b9-245a2a8b48c6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:09.712335 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6714a2cd-94f9-41ae-a2b9-245a2a8b48c6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:09.712805 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6714a2cd-94f9-41ae-a2b9-245a2a8b48c6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:09.928450 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6714a2cd-94f9-41ae-a2b9-245a2a8b48c6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:09.956909 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6714a2cd-94f9-41ae-a2b9-245a2a8b48c6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.269434 May 25 17:11:09.959429 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 142/267] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:09 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:10.425727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5ecc59ab-e310-47d8-b4c8-cc1ce84c3043 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:10.426535 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5ecc59ab-e310-47d8-b4c8-cc1ce84c3043 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:10.453140 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ecc59ab-e310-47d8-b4c8-cc1ce84c3043 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:10.454297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ecc59ab-e310-47d8-b4c8-cc1ce84c3043 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:10.457430 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ecc59ab-e310-47d8-b4c8-cc1ce84c3043 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:10.457875 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ecc59ab-e310-47d8-b4c8-cc1ce84c3043 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:10.662865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f43754f1-f667-40f1-8f8f-385c9d855c31 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:10.664094 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f43754f1-f667-40f1-8f8f-385c9d855c31 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:10.675514 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f43754f1-f667-40f1-8f8f-385c9d855c31 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:10.676846 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f43754f1-f667-40f1-8f8f-385c9d855c31 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:10.678916 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f43754f1-f667-40f1-8f8f-385c9d855c31 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:10.679981 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f43754f1-f667-40f1-8f8f-385c9d855c31 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:10.702372 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ecc59ab-e310-47d8-b4c8-cc1ce84c3043 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:10.712286 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ecc59ab-e310-47d8-b4c8-cc1ce84c3043 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:10.714762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ecc59ab-e310-47d8-b4c8-cc1ce84c3043 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:10.717038 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5ecc59ab-e310-47d8-b4c8-cc1ce84c3043 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.296559 May 25 17:11:10.717609 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f43754f1-f667-40f1-8f8f-385c9d855c31 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/ips" status: 200 len: 150 microversion: 2.1 time: 0.061202 May 25 17:11:10.718155 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 126/268] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:10 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:10.730188 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 143/269] 10.222.0.31 () {58 vars in 1247 bytes} [Wed May 25 17:11:10 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/ips => generated 150 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:10.976277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3ddf5932-6cec-474d-9374-402de2d5bc89 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:10.977265 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3ddf5932-6cec-474d-9374-402de2d5bc89 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:10.986155 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ddf5932-6cec-474d-9374-402de2d5bc89 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:10.986606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ddf5932-6cec-474d-9374-402de2d5bc89 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:10.987433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ddf5932-6cec-474d-9374-402de2d5bc89 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:10.987964 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ddf5932-6cec-474d-9374-402de2d5bc89 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:11.194439 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3ddf5932-6cec-474d-9374-402de2d5bc89 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:11.215105 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3ddf5932-6cec-474d-9374-402de2d5bc89 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.237851 May 25 17:11:11.215105 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 127/270] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:10 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:11.735999 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f953ed98-5ad5-4270-9acf-c322bcaacb7d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:11.736818 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f953ed98-5ad5-4270-9acf-c322bcaacb7d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:11.743832 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f953ed98-5ad5-4270-9acf-c322bcaacb7d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:11.744274 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f953ed98-5ad5-4270-9acf-c322bcaacb7d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:11.745080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f953ed98-5ad5-4270-9acf-c322bcaacb7d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:11.745804 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f953ed98-5ad5-4270-9acf-c322bcaacb7d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:11.890114 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f953ed98-5ad5-4270-9acf-c322bcaacb7d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:11.903643 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f953ed98-5ad5-4270-9acf-c322bcaacb7d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:11.906827 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f953ed98-5ad5-4270-9acf-c322bcaacb7d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:11.909172 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f953ed98-5ad5-4270-9acf-c322bcaacb7d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.177110 May 25 17:11:11.910359 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 144/271] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:11 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:12.226678 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-86776a69-309b-46b9-a2ef-1344dfa84b18 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:12.227788 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-86776a69-309b-46b9-a2ef-1344dfa84b18 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:12.234874 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-86776a69-309b-46b9-a2ef-1344dfa84b18 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:12.239717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-86776a69-309b-46b9-a2ef-1344dfa84b18 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:12.240940 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-86776a69-309b-46b9-a2ef-1344dfa84b18 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:12.241385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-86776a69-309b-46b9-a2ef-1344dfa84b18 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:12.283304 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a4518e7c-09bc-470b-a082-4ef0e0df8500 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce29024b-cc73-42a2-8ac1-90a4d8e82291"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:12.284449 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a4518e7c-09bc-470b-a082-4ef0e0df8500 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:12.291006 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a4518e7c-09bc-470b-a082-4ef0e0df8500 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:12.291697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a4518e7c-09bc-470b-a082-4ef0e0df8500 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:12.292631 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a4518e7c-09bc-470b-a082-4ef0e0df8500 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:12.295068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a4518e7c-09bc-470b-a082-4ef0e0df8500 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:12.430139 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-86776a69-309b-46b9-a2ef-1344dfa84b18 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:12.440221 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-86776a69-309b-46b9-a2ef-1344dfa84b18 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.217162 May 25 17:11:12.441558 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 128/272] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:12 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:12.931360 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-95f974af-4a79-4a4f-ba80-92addb7767eb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:12.932193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-95f974af-4a79-4a4f-ba80-92addb7767eb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:12.939239 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-95f974af-4a79-4a4f-ba80-92addb7767eb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:12.940161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-95f974af-4a79-4a4f-ba80-92addb7767eb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:12.941662 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-95f974af-4a79-4a4f-ba80-92addb7767eb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:12.942321 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-95f974af-4a79-4a4f-ba80-92addb7767eb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:13.154595 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-95f974af-4a79-4a4f-ba80-92addb7767eb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:13.170569 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-95f974af-4a79-4a4f-ba80-92addb7767eb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:13.172953 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-95f974af-4a79-4a4f-ba80-92addb7767eb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:13.174526 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-95f974af-4a79-4a4f-ba80-92addb7767eb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.247494 May 25 17:11:13.175369 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 129/273] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:12 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:13.459358 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2c8d028f-a8e4-43b7-b22b-80befd926fc9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:13.460384 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2c8d028f-a8e4-43b7-b22b-80befd926fc9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:13.465701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a4518e7c-09bc-470b-a082-4ef0e0df8500 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.186815 May 25 17:11:13.467743 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 145/274] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:11:12 2022] POST /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/os-volume_attachments => generated 194 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:13.485761 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c8d028f-a8e4-43b7-b22b-80befd926fc9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:13.489308 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c8d028f-a8e4-43b7-b22b-80befd926fc9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:13.489308 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c8d028f-a8e4-43b7-b22b-80befd926fc9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:13.490173 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c8d028f-a8e4-43b7-b22b-80befd926fc9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:13.698268 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2c8d028f-a8e4-43b7-b22b-80befd926fc9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:13.709959 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2c8d028f-a8e4-43b7-b22b-80befd926fc9 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1502 microversion: 2.1 time: 0.254099 May 25 17:11:13.710892 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 130/275] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:13 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1502 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:13.729484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3ee636e6-245a-4ede-a47e-0f718ba1a2a1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be5d4f3a-723c-41f3-878b-4fb4a5d7bd8c"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:13.731004 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3ee636e6-245a-4ede-a47e-0f718ba1a2a1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:13.738257 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3ee636e6-245a-4ede-a47e-0f718ba1a2a1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:13.738937 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3ee636e6-245a-4ede-a47e-0f718ba1a2a1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:13.739917 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3ee636e6-245a-4ede-a47e-0f718ba1a2a1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:13.740358 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3ee636e6-245a-4ede-a47e-0f718ba1a2a1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:13.767290 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-3ee636e6-245a-4ede-a47e-0f718ba1a2a1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] HTTP exception thrown: Cannot 'attach_volume' instance 8f434295-7a0d-4d51-8f4e-6698b399b20a while it is in vm_state rescued May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3ee636e6-245a-4ede-a47e-0f718ba1a2a1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Request method failure captured: May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: POST /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a/os-volume_attachments HTTP/1.1 May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 74 May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLGYNd6G28K1F5Vwuevv8bNAGGyG1KQn063AvRNDkhQrhv_VbNEELILAkCaqLFEwEvi0Dvqfjkudz0zR6iHLoRxopgyicuFaijxVda3PK2EFG_6MHUTTsVLuxNFtbXb3F8H7RaOoUvDqTOonq2st05ntld3RmPG6CBG3ac_shdb1ug May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 8c297ec7b46943f594b67c95479f1f7c May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:11:13.769618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/8c297ec7b46943f594b67c95479f1f7c"}]}] May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 8c297ec7b46943f594b67c95479f1f7c May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-ServerRescueNegativeTestJSON-122117092-project May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3f51c03f7fe54451b49ddb32fc337b98 May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-122117092-project May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {"volumeAttachment": {"volumeId": "be5d4f3a-723c-41f3-878b-4fb4a5d7bd8c"}} May 25 17:11:13.771270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Cannot 'attach_volume' instance 8f434295-7a0d-4d51-8f4e-6698b399b20a while it is in vm_state rescued May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'server_id': '8f434295-7a0d-4d51-8f4e-6698b399b20a', 'body': {'volumeAttachment': {'volumeId': 'be5d4f3a-723c-41f3-878b-4fb4a5d7bd8c'}}} May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8f434295-7a0d-4d51-8f4e-6698b399b20a in vm_state rescued. Cannot attach_volume while the instance is in this state. May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:11:13.772132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8f434295-7a0d-4d51-8f4e-6698b399b20a while it is in vm_state rescued May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:11:13.773574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:11:13.774867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:11:13.774867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:11:13.774867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8f434295-7a0d-4d51-8f4e-6698b399b20a while it is in vm_state rescued May 25 17:11:13.774867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:11:13.777597 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3ee636e6-245a-4ede-a47e-0f718ba1a2a1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Returning 409 to user: Cannot 'attach_volume' instance 8f434295-7a0d-4d51-8f4e-6698b399b20a while it is in vm_state rescued {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:11:13.778661 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3ee636e6-245a-4ede-a47e-0f718ba1a2a1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054100 May 25 17:11:13.779744 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 146/276] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:11:13 2022] POST /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 17:11:13.792644 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ea97d129-9e82-474d-9959-6e05f9ab1cd3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:13.793597 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ea97d129-9e82-474d-9959-6e05f9ab1cd3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:13.802954 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ea97d129-9e82-474d-9959-6e05f9ab1cd3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:13.803424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ea97d129-9e82-474d-9959-6e05f9ab1cd3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:13.804302 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ea97d129-9e82-474d-9959-6e05f9ab1cd3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:13.804806 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ea97d129-9e82-474d-9959-6e05f9ab1cd3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:13.945443 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ea97d129-9e82-474d-9959-6e05f9ab1cd3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a/action" status: 202 len: 0 microversion: 2.1 time: 0.157971 May 25 17:11:13.950471 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 131/277] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:11:13 2022] POST /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 17:11:13.959573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-49ee272a-f340-4491-b310-e8df213e94ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:13.960440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-49ee272a-f340-4491-b310-e8df213e94ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:13.976032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-49ee272a-f340-4491-b310-e8df213e94ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:13.976694 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-49ee272a-f340-4491-b310-e8df213e94ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:13.980775 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-49ee272a-f340-4491-b310-e8df213e94ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:13.981388 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-49ee272a-f340-4491-b310-e8df213e94ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:14.199092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b6dba93d-3990-4f3a-b70d-dddebca96511 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:14.199092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b6dba93d-3990-4f3a-b70d-dddebca96511 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:14.206886 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b6dba93d-3990-4f3a-b70d-dddebca96511 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:14.208592 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b6dba93d-3990-4f3a-b70d-dddebca96511 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:14.209825 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b6dba93d-3990-4f3a-b70d-dddebca96511 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:14.210459 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b6dba93d-3990-4f3a-b70d-dddebca96511 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:14.434011 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-49ee272a-f340-4491-b310-e8df213e94ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:14.464064 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-49ee272a-f340-4491-b310-e8df213e94ba tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1510 microversion: 2.1 time: 0.508537 May 25 17:11:14.464484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 147/278] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:13 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1510 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:14.557448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b6dba93d-3990-4f3a-b70d-dddebca96511 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:14.571699 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b6dba93d-3990-4f3a-b70d-dddebca96511 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:14.577152 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b6dba93d-3990-4f3a-b70d-dddebca96511 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:14.583787 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b6dba93d-3990-4f3a-b70d-dddebca96511 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.392155 May 25 17:11:14.585113 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 132/279] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:14 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:15.483067 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-06192061-5bc9-44c2-9e0f-45f248aeb904 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:15.484550 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-06192061-5bc9-44c2-9e0f-45f248aeb904 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:15.496120 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06192061-5bc9-44c2-9e0f-45f248aeb904 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:15.498573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06192061-5bc9-44c2-9e0f-45f248aeb904 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:15.499377 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06192061-5bc9-44c2-9e0f-45f248aeb904 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:15.500446 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06192061-5bc9-44c2-9e0f-45f248aeb904 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:15.604255 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ffedd6e-aef7-4491-9d69-e40d949bc72e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:15.605790 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0ffedd6e-aef7-4491-9d69-e40d949bc72e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:15.614491 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ffedd6e-aef7-4491-9d69-e40d949bc72e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:15.614945 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ffedd6e-aef7-4491-9d69-e40d949bc72e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:15.615742 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ffedd6e-aef7-4491-9d69-e40d949bc72e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:15.616191 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ffedd6e-aef7-4491-9d69-e40d949bc72e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:15.764596 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-06192061-5bc9-44c2-9e0f-45f248aeb904 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:15.799791 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-06192061-5bc9-44c2-9e0f-45f248aeb904 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1510 microversion: 2.1 time: 0.302545 May 25 17:11:15.802382 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 148/280] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:15 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1510 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:15.944654 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0ffedd6e-aef7-4491-9d69-e40d949bc72e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:15.958908 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0ffedd6e-aef7-4491-9d69-e40d949bc72e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:15.961551 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0ffedd6e-aef7-4491-9d69-e40d949bc72e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:15.963061 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0ffedd6e-aef7-4491-9d69-e40d949bc72e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.364174 May 25 17:11:15.965553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 133/281] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:15 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:16.819997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d2e0fcee-0881-4fd1-873e-840f22401a16 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:16.821368 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d2e0fcee-0881-4fd1-873e-840f22401a16 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:16.845461 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d2e0fcee-0881-4fd1-873e-840f22401a16 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:16.846825 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d2e0fcee-0881-4fd1-873e-840f22401a16 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:16.847845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d2e0fcee-0881-4fd1-873e-840f22401a16 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:16.848434 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d2e0fcee-0881-4fd1-873e-840f22401a16 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:16.992157 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-058e30c6-aa3d-4670-8d9b-c2a537483856 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:16.996282 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-058e30c6-aa3d-4670-8d9b-c2a537483856 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:17.032412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-058e30c6-aa3d-4670-8d9b-c2a537483856 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:17.039677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-058e30c6-aa3d-4670-8d9b-c2a537483856 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:17.042571 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-058e30c6-aa3d-4670-8d9b-c2a537483856 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:17.043172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-058e30c6-aa3d-4670-8d9b-c2a537483856 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:17.285263 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d2e0fcee-0881-4fd1-873e-840f22401a16 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:17.298583 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-058e30c6-aa3d-4670-8d9b-c2a537483856 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:17.314877 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d2e0fcee-0881-4fd1-873e-840f22401a16 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1510 microversion: 2.1 time: 0.499331 May 25 17:11:17.318677 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 149/282] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:16 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:17.319444 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-058e30c6-aa3d-4670-8d9b-c2a537483856 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:17.322137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-058e30c6-aa3d-4670-8d9b-c2a537483856 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:17.324603 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-058e30c6-aa3d-4670-8d9b-c2a537483856 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.345116 May 25 17:11:17.326003 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 134/283] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:16 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:18.338246 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-dec1a1d8-9197-45d6-85bd-d87d3cbca57c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:18.338875 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-dec1a1d8-9197-45d6-85bd-d87d3cbca57c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:18.387997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-dec1a1d8-9197-45d6-85bd-d87d3cbca57c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:18.389310 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-94e2163a-d326-4335-b3be-7d1b1c3904dd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:18.391574 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-94e2163a-d326-4335-b3be-7d1b1c3904dd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:18.395039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-dec1a1d8-9197-45d6-85bd-d87d3cbca57c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:18.401198 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-dec1a1d8-9197-45d6-85bd-d87d3cbca57c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:18.403372 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-dec1a1d8-9197-45d6-85bd-d87d3cbca57c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:18.407783 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-94e2163a-d326-4335-b3be-7d1b1c3904dd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:18.408565 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-94e2163a-d326-4335-b3be-7d1b1c3904dd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:18.412220 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-94e2163a-d326-4335-b3be-7d1b1c3904dd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:18.413098 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-94e2163a-d326-4335-b3be-7d1b1c3904dd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:18.987611 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-94e2163a-d326-4335-b3be-7d1b1c3904dd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:19.009700 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-94e2163a-d326-4335-b3be-7d1b1c3904dd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:19.011751 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-94e2163a-d326-4335-b3be-7d1b1c3904dd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:19.013240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-94e2163a-d326-4335-b3be-7d1b1c3904dd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.673090 May 25 17:11:19.014321 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 135/284] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:18 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:19.086594 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-dec1a1d8-9197-45d6-85bd-d87d3cbca57c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:19.103162 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-dec1a1d8-9197-45d6-85bd-d87d3cbca57c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1516 microversion: 2.1 time: 0.771818 May 25 17:11:19.109395 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 150/285] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:18 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1516 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:19.118304 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4ea13284-dbab-4926-b9e0-87e7f1d62994 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:19.126894 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4ea13284-dbab-4926-b9e0-87e7f1d62994 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:19.127358 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4ea13284-dbab-4926-b9e0-87e7f1d62994 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:19.242955 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4ea13284-dbab-4926-b9e0-87e7f1d62994 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Going to try to stop instance {{(pid=117696) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 17:11:19.363503 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4ea13284-dbab-4926-b9e0-87e7f1d62994 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/action" status: 202 len: 0 microversion: 2.1 time: 0.246421 May 25 17:11:19.368232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 136/286] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:11:19 2022] POST /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:11:19.392654 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-475f6b87-e828-4276-98d4-88bef2cb99e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:19.394899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-475f6b87-e828-4276-98d4-88bef2cb99e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:19.412940 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-475f6b87-e828-4276-98d4-88bef2cb99e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:19.413672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-475f6b87-e828-4276-98d4-88bef2cb99e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:19.414990 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-475f6b87-e828-4276-98d4-88bef2cb99e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:19.415595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-475f6b87-e828-4276-98d4-88bef2cb99e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:20.037598 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8b25d861-df17-4aec-a413-47fd0160c8e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:20.038346 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8b25d861-df17-4aec-a413-47fd0160c8e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:20.058818 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b25d861-df17-4aec-a413-47fd0160c8e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:20.059497 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b25d861-df17-4aec-a413-47fd0160c8e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:20.060807 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b25d861-df17-4aec-a413-47fd0160c8e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:20.061583 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b25d861-df17-4aec-a413-47fd0160c8e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:20.078868 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-475f6b87-e828-4276-98d4-88bef2cb99e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:20.088517 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-475f6b87-e828-4276-98d4-88bef2cb99e6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.715502 May 25 17:11:20.089504 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 151/287] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:19 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:20.299920 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8b25d861-df17-4aec-a413-47fd0160c8e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:20.339620 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8b25d861-df17-4aec-a413-47fd0160c8e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:20.345184 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8b25d861-df17-4aec-a413-47fd0160c8e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:20.346561 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8b25d861-df17-4aec-a413-47fd0160c8e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.313663 May 25 17:11:20.349040 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 137/288] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:20 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:21.031221 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-fa959c9c-0858-4f2b-bdbd-0a7d53ea8ee7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'create', calling method: .version_select at 0x7f3d4e386af0>, body: {"keypair": {"name": "tempest-keypair-799155635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0pe3KWAm/PUYy5YJTOQjWjug5c31EKNPBZi6xQaQPwfLUqgb+ENJ0u0sq85NTClo779mhuH69Y95zNyeFCHbADBYYBGMSbEtsZJNyJ0lAlEhJwSxjj//s9LHSrJ4K9ig=="}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:21.087073 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-fa959c9c-0858-4f2b-bdbd-0a7d53ea8ee7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Getting quotas for project 8c297ec7b46943f594b67c95479f1f7c. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:11:21.091941 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-fa959c9c-0858-4f2b-bdbd-0a7d53ea8ee7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Getting quotas for user 3f51c03f7fe54451b49ddb32fc337b98 and project 8c297ec7b46943f594b67c95479f1f7c. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:11:21.107084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4dc75ead-a952-48cc-aad2-8a74f6e4e1b5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:21.108327 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4dc75ead-a952-48cc-aad2-8a74f6e4e1b5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:21.133556 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4dc75ead-a952-48cc-aad2-8a74f6e4e1b5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:21.137487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4dc75ead-a952-48cc-aad2-8a74f6e4e1b5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:21.138623 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4dc75ead-a952-48cc-aad2-8a74f6e4e1b5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:21.139075 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4dc75ead-a952-48cc-aad2-8a74f6e4e1b5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:21.162425 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-fa959c9c-0858-4f2b-bdbd-0a7d53ea8ee7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136029 May 25 17:11:21.163470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 152/289] 10.222.0.31 () {60 vars in 1158 bytes} [Wed May 25 17:11:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:21.371638 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5abdb662-58e9-41d5-be77-e8bd8c53d32d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:21.372513 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5abdb662-58e9-41d5-be77-e8bd8c53d32d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:21.385970 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5abdb662-58e9-41d5-be77-e8bd8c53d32d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:21.386429 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5abdb662-58e9-41d5-be77-e8bd8c53d32d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:21.387232 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5abdb662-58e9-41d5-be77-e8bd8c53d32d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:21.395187 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5abdb662-58e9-41d5-be77-e8bd8c53d32d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:21.608999 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4dc75ead-a952-48cc-aad2-8a74f6e4e1b5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:21.623013 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4dc75ead-a952-48cc-aad2-8a74f6e4e1b5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.520171 May 25 17:11:21.623856 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 138/290] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:21 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:21.820156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5abdb662-58e9-41d5-be77-e8bd8c53d32d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:21.838512 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5abdb662-58e9-41d5-be77-e8bd8c53d32d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:21.844064 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5abdb662-58e9-41d5-be77-e8bd8c53d32d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:21.845471 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5abdb662-58e9-41d5-be77-e8bd8c53d32d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.481076 May 25 17:11:21.848878 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 153/291] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:21 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:22.643413 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e2555696-38e0-4640-8ea9-25c300e6864d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:22.644010 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e2555696-38e0-4640-8ea9-25c300e6864d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:22.651493 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e2555696-38e0-4640-8ea9-25c300e6864d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:22.654040 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e2555696-38e0-4640-8ea9-25c300e6864d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:22.655346 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e2555696-38e0-4640-8ea9-25c300e6864d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:22.656491 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e2555696-38e0-4640-8ea9-25c300e6864d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:22.867901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4bf25031-f035-432d-b424-500f56730f8a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:22.868507 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4bf25031-f035-432d-b424-500f56730f8a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:22.876422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4bf25031-f035-432d-b424-500f56730f8a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:22.877164 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4bf25031-f035-432d-b424-500f56730f8a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:22.878806 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4bf25031-f035-432d-b424-500f56730f8a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:22.879429 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4bf25031-f035-432d-b424-500f56730f8a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:22.950280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e2555696-38e0-4640-8ea9-25c300e6864d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:22.953169 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:22.973781 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e2555696-38e0-4640-8ea9-25c300e6864d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.334141 May 25 17:11:22.974733 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 139/292] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:22 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:23.222638 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4bf25031-f035-432d-b424-500f56730f8a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:23.234800 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4bf25031-f035-432d-b424-500f56730f8a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:23.249230 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4bf25031-f035-432d-b424-500f56730f8a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:23.251227 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4bf25031-f035-432d-b424-500f56730f8a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1743 microversion: 2.20 time: 0.387674 May 25 17:11:23.267126 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 154/293] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:22 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1743 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:23.383543 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-899007396", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79368167-854c-4f50-95fb-3c054bede279"}], "security_groups": [{"name": "tempest-securitygroup--1264890245"}], "key_name": "tempest-keypair-799155635", "user_data": "}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:23.992166 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-bc26dc9e-30a2-4de2-8622-7a471e38fbed tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:23.998686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-bc26dc9e-30a2-4de2-8622-7a471e38fbed tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:24.006245 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bc26dc9e-30a2-4de2-8622-7a471e38fbed tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:24.006712 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bc26dc9e-30a2-4de2-8622-7a471e38fbed tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:24.025423 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bc26dc9e-30a2-4de2-8622-7a471e38fbed tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:24.025887 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bc26dc9e-30a2-4de2-8622-7a471e38fbed tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:24.103403 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] validate_networks() for [('79368167-854c-4f50-95fb-3c054bede279', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:11:24.286080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-bc26dc9e-30a2-4de2-8622-7a471e38fbed tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:24.304209 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-bc26dc9e-30a2-4de2-8622-7a471e38fbed tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.310611 May 25 17:11:24.304912 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 155/294] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:23 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:24.326398 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-801a4889-192f-4727-a69d-01a9f134e0aa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:24.328417 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-801a4889-192f-4727-a69d-01a9f134e0aa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:24.343657 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-801a4889-192f-4727-a69d-01a9f134e0aa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:24.346788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-801a4889-192f-4727-a69d-01a9f134e0aa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:24.359224 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-801a4889-192f-4727-a69d-01a9f134e0aa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:24.364474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-801a4889-192f-4727-a69d-01a9f134e0aa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:24.670383 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:11:24.670814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:11:24.671916 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:11:24.672504 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:11:24.673126 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:11:24.695797 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:24.696472 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:24.698740 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:24.699309 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:24.732540 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Getting quotas for project 8c297ec7b46943f594b67c95479f1f7c. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:11:24.738224 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Getting quotas for user 3f51c03f7fe54451b49ddb32fc337b98 and project 8c297ec7b46943f594b67c95479f1f7c. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:11:24.779657 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:11:24.782351 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:11:24.799622 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-801a4889-192f-4727-a69d-01a9f134e0aa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:24.833403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-801a4889-192f-4727-a69d-01a9f134e0aa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:24.836950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-801a4889-192f-4727-a69d-01a9f134e0aa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:24.838554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-801a4889-192f-4727-a69d-01a9f134e0aa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1743 microversion: 2.20 time: 0.532269 May 25 17:11:24.846788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 156/295] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:24 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1743 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:24.869975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fb1822d6-da12-4efc-957e-034c8de518ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.493378 May 25 17:11:24.871424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 140/296] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:11:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:11:24.883079 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-cf86a77a-7c18-4ac4-ab76-23fb711dbe64 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:24.883982 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-cf86a77a-7c18-4ac4-ab76-23fb711dbe64 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:25.009061 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-cf86a77a-7c18-4ac4-ab76-23fb711dbe64 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:25.021676 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-cf86a77a-7c18-4ac4-ab76-23fb711dbe64 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1244 microversion: 2.1 time: 0.141999 May 25 17:11:25.034628 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 157/297] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:24 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1244 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:25.331250 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-71d6e288-089f-42c2-9d36-98246a764c92 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:25.332210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-71d6e288-089f-42c2-9d36-98246a764c92 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:25.350513 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71d6e288-089f-42c2-9d36-98246a764c92 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:25.351288 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71d6e288-089f-42c2-9d36-98246a764c92 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:25.356404 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71d6e288-089f-42c2-9d36-98246a764c92 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:25.357315 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71d6e288-089f-42c2-9d36-98246a764c92 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:25.805816 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-71d6e288-089f-42c2-9d36-98246a764c92 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:25.825433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-71d6e288-089f-42c2-9d36-98246a764c92 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.505231 May 25 17:11:25.829455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 141/298] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:25 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:25.866214 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-be94604f-f843-422c-ac83-709ce99767ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:25.867067 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-be94604f-f843-422c-ac83-709ce99767ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:25.880822 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be94604f-f843-422c-ac83-709ce99767ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:25.888295 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be94604f-f843-422c-ac83-709ce99767ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:25.893487 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be94604f-f843-422c-ac83-709ce99767ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:25.894235 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be94604f-f843-422c-ac83-709ce99767ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:25.908831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:26.049391 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-14100756-fed3-48b5-8b55-6a8e61fe56e4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:26.050554 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-14100756-fed3-48b5-8b55-6a8e61fe56e4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:26.066756 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-14100756-fed3-48b5-8b55-6a8e61fe56e4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:26.067221 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-14100756-fed3-48b5-8b55-6a8e61fe56e4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:26.070030 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-14100756-fed3-48b5-8b55-6a8e61fe56e4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:26.070668 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-14100756-fed3-48b5-8b55-6a8e61fe56e4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:26.299933 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-14100756-fed3-48b5-8b55-6a8e61fe56e4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:26.308370 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-be94604f-f843-422c-ac83-709ce99767ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:26.313731 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-14100756-fed3-48b5-8b55-6a8e61fe56e4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1240 microversion: 2.1 time: 0.277061 May 25 17:11:26.314789 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 142/299] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:26 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1240 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:26.330697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-be94604f-f843-422c-ac83-709ce99767ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:26.333018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-be94604f-f843-422c-ac83-709ce99767ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:26.335294 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-95c5d387-a8f9-4c7a-a837-8fb110f558ba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: .version_select at 0x7f3d4ea18f70>, body: {"keypair": {"name": "tempest-keypair-1064814291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYTwJP5kJib8+MdadczqrDz7JGzRnx/H08N0e4PGtegbt90kPbbBux8p+I8RUhWr/m689//1pCTzEG54rtKO4pTrZ5lUf2wto1trXjZCChZokNm43IKEEN9PGlEUzBo5Q=="}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:26.336905 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-be94604f-f843-422c-ac83-709ce99767ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1743 microversion: 2.20 time: 0.476260 May 25 17:11:26.338162 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 158/300] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:25 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1743 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:26.371561 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-95c5d387-a8f9-4c7a-a837-8fb110f558ba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:11:26.379247 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-95c5d387-a8f9-4c7a-a837-8fb110f558ba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for user 3fb5eecf3e244058905ea3aba8112320 and project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:11:26.429917 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-95c5d387-a8f9-4c7a-a837-8fb110f558ba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113200 May 25 17:11:26.430907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 143/301] 10.222.0.31 () {60 vars in 1158 bytes} [Wed May 25 17:11:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:26.846306 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ecd9ca9f-efab-4785-814a-0fb62083d404 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:26.850235 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ecd9ca9f-efab-4785-814a-0fb62083d404 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:26.863880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ecd9ca9f-efab-4785-814a-0fb62083d404 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:26.864402 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ecd9ca9f-efab-4785-814a-0fb62083d404 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:26.867309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ecd9ca9f-efab-4785-814a-0fb62083d404 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:26.868489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ecd9ca9f-efab-4785-814a-0fb62083d404 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:27.334641 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-35de2a53-0216-4766-9427-8b21e3a32727 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:27.335515 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-35de2a53-0216-4766-9427-8b21e3a32727 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:27.343110 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-35de2a53-0216-4766-9427-8b21e3a32727 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:27.346038 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-35de2a53-0216-4766-9427-8b21e3a32727 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:27.347173 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-35de2a53-0216-4766-9427-8b21e3a32727 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:27.347823 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-35de2a53-0216-4766-9427-8b21e3a32727 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:27.453823 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-35de2a53-0216-4766-9427-8b21e3a32727 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:27.472859 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-35de2a53-0216-4766-9427-8b21e3a32727 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1302 microversion: 2.1 time: 0.142653 May 25 17:11:27.475915 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 144/302] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:27 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1302 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:27.498937 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e21a42e8-d5b9-40a2-a099-20eecc4568ba tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:27.502202 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e21a42e8-d5b9-40a2-a099-20eecc4568ba tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:27.523603 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e21a42e8-d5b9-40a2-a099-20eecc4568ba tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:27.524852 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e21a42e8-d5b9-40a2-a099-20eecc4568ba tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:27.525899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e21a42e8-d5b9-40a2-a099-20eecc4568ba tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:27.526535 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e21a42e8-d5b9-40a2-a099-20eecc4568ba tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:28.125692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ecd9ca9f-efab-4785-814a-0fb62083d404 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:28.142882 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ecd9ca9f-efab-4785-814a-0fb62083d404 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 1.301789 May 25 17:11:28.149460 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 159/303] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:26 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:28.498682 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-29b8f619-9358-4b5f-8472-b723944a4c0d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:28.500770 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-29b8f619-9358-4b5f-8472-b723944a4c0d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:28.530706 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-29b8f619-9358-4b5f-8472-b723944a4c0d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:28.531478 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-29b8f619-9358-4b5f-8472-b723944a4c0d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:28.532476 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-29b8f619-9358-4b5f-8472-b723944a4c0d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:28.532961 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-29b8f619-9358-4b5f-8472-b723944a4c0d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:28.851502 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e21a42e8-d5b9-40a2-a099-20eecc4568ba tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:28.859500 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e21a42e8-d5b9-40a2-a099-20eecc4568ba tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:28.861078 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e21a42e8-d5b9-40a2-a099-20eecc4568ba tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:28.862267 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e21a42e8-d5b9-40a2-a099-20eecc4568ba tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 1.382549 May 25 17:11:28.862818 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 145/304] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:27 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:29.047997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-29b8f619-9358-4b5f-8472-b723944a4c0d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:29.065223 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-29b8f619-9358-4b5f-8472-b723944a4c0d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1302 microversion: 2.1 time: 0.572620 May 25 17:11:29.078838 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 160/305] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:28 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1302 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:29.166735 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5ce2d132-f094-410e-a355-467efd5d30ea tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:29.167345 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5ce2d132-f094-410e-a355-467efd5d30ea tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:29.188695 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ce2d132-f094-410e-a355-467efd5d30ea tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:29.190796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ce2d132-f094-410e-a355-467efd5d30ea tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:29.191624 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ce2d132-f094-410e-a355-467efd5d30ea tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:29.192065 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ce2d132-f094-410e-a355-467efd5d30ea tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:29.610487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ce2d132-f094-410e-a355-467efd5d30ea tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:29.625111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5ce2d132-f094-410e-a355-467efd5d30ea tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.461355 May 25 17:11:29.644529 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 146/306] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:29 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:29.650987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-377778de-5728-4205-ad03-225217fe7af8 req-1804a0b9-2115-4984-af0c-10542c43e76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99e2d9c-ac45-4a8e-8076-faaf830c29e0", "name": "network-vif-plugged", "status": "completed", "tag": "fa9d31d9-985b-4772-a564-1cbeee313f84"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:29.664805 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-377778de-5728-4205-ad03-225217fe7af8 req-1804a0b9-2115-4984-af0c-10542c43e76d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:29.665248 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-377778de-5728-4205-ad03-225217fe7af8 req-1804a0b9-2115-4984-af0c-10542c43e76d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:29.741369 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-377778de-5728-4205-ad03-225217fe7af8 req-1804a0b9-2115-4984-af0c-10542c43e76d service nova] Creating event network-vif-plugged:fa9d31d9-985b-4772-a564-1cbeee313f84 for instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 on hv-cinder-84330 May 25 17:11:29.747148 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-377778de-5728-4205-ad03-225217fe7af8 req-1804a0b9-2115-4984-af0c-10542c43e76d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108971 May 25 17:11:29.754447 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 161/307] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:29.883491 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f8c4f897-373d-46db-90f8-d767ceac4033 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:29.884661 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f8c4f897-373d-46db-90f8-d767ceac4033 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:29.910456 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f8c4f897-373d-46db-90f8-d767ceac4033 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:29.913118 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f8c4f897-373d-46db-90f8-d767ceac4033 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:29.914444 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f8c4f897-373d-46db-90f8-d767ceac4033 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:29.915477 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f8c4f897-373d-46db-90f8-d767ceac4033 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:30.097949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-661b4817-a6c1-41ce-b8c8-566283d57c26 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:30.105768 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-661b4817-a6c1-41ce-b8c8-566283d57c26 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:30.145723 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-661b4817-a6c1-41ce-b8c8-566283d57c26 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:30.147803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-661b4817-a6c1-41ce-b8c8-566283d57c26 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:30.148733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-661b4817-a6c1-41ce-b8c8-566283d57c26 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:30.150247 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-661b4817-a6c1-41ce-b8c8-566283d57c26 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:30.283488 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f8c4f897-373d-46db-90f8-d767ceac4033 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:30.293767 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f8c4f897-373d-46db-90f8-d767ceac4033 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:30.295806 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f8c4f897-373d-46db-90f8-d767ceac4033 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:30.298248 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f8c4f897-373d-46db-90f8-d767ceac4033 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.418711 May 25 17:11:30.299665 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 147/308] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:29 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:30.435137 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-661b4817-a6c1-41ce-b8c8-566283d57c26 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:30.454919 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-661b4817-a6c1-41ce-b8c8-566283d57c26 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1302 microversion: 2.1 time: 0.363101 May 25 17:11:30.455950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 162/309] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:30 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1302 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:30.673552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-28159b10-7d45-461f-aacd-bcb06af2750a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:30.674570 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-28159b10-7d45-461f-aacd-bcb06af2750a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:30.705865 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-28159b10-7d45-461f-aacd-bcb06af2750a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:30.714751 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-28159b10-7d45-461f-aacd-bcb06af2750a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:30.715611 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-28159b10-7d45-461f-aacd-bcb06af2750a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:30.716662 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-28159b10-7d45-461f-aacd-bcb06af2750a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:31.023835 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-28159b10-7d45-461f-aacd-bcb06af2750a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:31.032516 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-28159b10-7d45-461f-aacd-bcb06af2750a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.374008 May 25 17:11:31.041463 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 148/310] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:30 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:31.319579 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-21858847-82a6-4780-a1aa-b315fe8fb3ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:31.320626 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-21858847-82a6-4780-a1aa-b315fe8fb3ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:31.332435 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:31.336783 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-21858847-82a6-4780-a1aa-b315fe8fb3ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:31.337249 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-21858847-82a6-4780-a1aa-b315fe8fb3ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:31.338037 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-21858847-82a6-4780-a1aa-b315fe8fb3ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:31.338484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-21858847-82a6-4780-a1aa-b315fe8fb3ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:31.480928 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e0f0dd08-7983-469b-9c91-0c803fc26c15 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:31.481288 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e0f0dd08-7983-469b-9c91-0c803fc26c15 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:31.497077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e0f0dd08-7983-469b-9c91-0c803fc26c15 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:31.497806 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e0f0dd08-7983-469b-9c91-0c803fc26c15 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:31.498784 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e0f0dd08-7983-469b-9c91-0c803fc26c15 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:31.500341 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e0f0dd08-7983-469b-9c91-0c803fc26c15 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:31.743906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e0f0dd08-7983-469b-9c91-0c803fc26c15 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:31.759403 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e0f0dd08-7983-469b-9c91-0c803fc26c15 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1370 microversion: 2.1 time: 0.290692 May 25 17:11:31.761585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 149/311] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:31 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1370 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:32.050677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e5855b3c-4c0b-4f48-ab7d-42c807bab9fa tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:32.052201 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e5855b3c-4c0b-4f48-ab7d-42c807bab9fa tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:32.079162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5855b3c-4c0b-4f48-ab7d-42c807bab9fa tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:32.079664 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5855b3c-4c0b-4f48-ab7d-42c807bab9fa tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:32.085764 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5855b3c-4c0b-4f48-ab7d-42c807bab9fa tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:32.090182 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5855b3c-4c0b-4f48-ab7d-42c807bab9fa tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:32.098264 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-21858847-82a6-4780-a1aa-b315fe8fb3ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:32.112121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-21858847-82a6-4780-a1aa-b315fe8fb3ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:32.116450 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-21858847-82a6-4780-a1aa-b315fe8fb3ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:32.117716 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-21858847-82a6-4780-a1aa-b315fe8fb3ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.803744 May 25 17:11:32.128098 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 163/312] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:31 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:32.722257 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e5855b3c-4c0b-4f48-ab7d-42c807bab9fa tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:32.730827 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e5855b3c-4c0b-4f48-ab7d-42c807bab9fa tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.684983 May 25 17:11:32.737058 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 150/313] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:32 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:32.781378 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-78e03c73-ab1b-4c49-9a02-a5bf4d2a15e1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:32.782777 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-78e03c73-ab1b-4c49-9a02-a5bf4d2a15e1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:32.800443 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-78e03c73-ab1b-4c49-9a02-a5bf4d2a15e1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:32.801332 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-78e03c73-ab1b-4c49-9a02-a5bf4d2a15e1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:32.802497 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-78e03c73-ab1b-4c49-9a02-a5bf4d2a15e1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:32.803158 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-78e03c73-ab1b-4c49-9a02-a5bf4d2a15e1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:32.934368 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-584534770", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94689dfe-6d66-4ed0-9452-eee0a515d2d3"}], "security_groups": [{"name": "tempest-securitygroup--105915554"}], "key_name": "tempest-keypair-1064814291", "user_data": "}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:33.199748 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] validate_networks() for [('94689dfe-6d66-4ed0-9452-eee0a515d2d3', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:11:33.277737 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-78e03c73-ab1b-4c49-9a02-a5bf4d2a15e1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:33.285820 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-78e03c73-ab1b-4c49-9a02-a5bf4d2a15e1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1370 microversion: 2.1 time: 0.512057 May 25 17:11:33.292849 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 164/314] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:32 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1370 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:33.298544 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a81031d0-4f7f-4853-9dad-5afd3b3e1a81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:33.299161 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a81031d0-4f7f-4853-9dad-5afd3b3e1a81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:33.317944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a81031d0-4f7f-4853-9dad-5afd3b3e1a81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:33.318669 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a81031d0-4f7f-4853-9dad-5afd3b3e1a81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:33.321211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a81031d0-4f7f-4853-9dad-5afd3b3e1a81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:33.322566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a81031d0-4f7f-4853-9dad-5afd3b3e1a81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:33.795930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:11:33.796842 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:11:33.796957 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:11:33.797279 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:11:33.800770 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:11:33.803275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:33.823437 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:33.824304 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:33.825721 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:33.830332 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:33.866739 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:11:33.875573 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for user 3fb5eecf3e244058905ea3aba8112320 and project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:11:33.897532 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:11:33.902423 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:11:33.977524 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a81031d0-4f7f-4853-9dad-5afd3b3e1a81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:33.987203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a81031d0-4f7f-4853-9dad-5afd3b3e1a81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:33.988749 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a81031d0-4f7f-4853-9dad-5afd3b3e1a81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:34.000780 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a81031d0-4f7f-4853-9dad-5afd3b3e1a81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.706745 May 25 17:11:34.001386 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 165/315] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:33 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:34.009381 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-eda19719-ab09-4962-9311-e839c48a4bc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:34.010463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-eda19719-ab09-4962-9311-e839c48a4bc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:34.022604 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-804e38ba-509e-402d-91cc-b1f5a8a6a1d2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.092476 May 25 17:11:34.023458 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 151/316] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:11:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:11:34.041744 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eda19719-ab09-4962-9311-e839c48a4bc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:34.042208 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eda19719-ab09-4962-9311-e839c48a4bc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:34.042995 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eda19719-ab09-4962-9311-e839c48a4bc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:34.043439 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eda19719-ab09-4962-9311-e839c48a4bc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:34.044079 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c26ad8cf-be5c-44e8-8b7a-1b97b2c4eed5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:34.044851 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c26ad8cf-be5c-44e8-8b7a-1b97b2c4eed5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:34.222111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c26ad8cf-be5c-44e8-8b7a-1b97b2c4eed5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:34.230280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c26ad8cf-be5c-44e8-8b7a-1b97b2c4eed5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1241 microversion: 2.1 time: 0.197624 May 25 17:11:34.271210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 152/317] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:34 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1241 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:34.327814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6c7f53d8-53bc-47b1-b3f6-5d10c20e9be1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:34.327814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6c7f53d8-53bc-47b1-b3f6-5d10c20e9be1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:34.330731 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c7f53d8-53bc-47b1-b3f6-5d10c20e9be1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:34.335020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c7f53d8-53bc-47b1-b3f6-5d10c20e9be1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:34.341190 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c7f53d8-53bc-47b1-b3f6-5d10c20e9be1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:34.369069 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c7f53d8-53bc-47b1-b3f6-5d10c20e9be1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:34.540617 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-eda19719-ab09-4962-9311-e839c48a4bc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:34.566957 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-eda19719-ab09-4962-9311-e839c48a4bc1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.561073 May 25 17:11:34.573786 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 166/318] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:34 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:34.835004 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6c7f53d8-53bc-47b1-b3f6-5d10c20e9be1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:34.842408 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6c7f53d8-53bc-47b1-b3f6-5d10c20e9be1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1370 microversion: 2.1 time: 0.531615 May 25 17:11:34.848749 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 153/319] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:34 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1370 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:35.018691 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4f2158f1-1d53-414f-a6ae-215affb7f7b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:35.020668 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4f2158f1-1d53-414f-a6ae-215affb7f7b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:35.024671 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=6 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:35.027394 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4f2158f1-1d53-414f-a6ae-215affb7f7b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:35.027723 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4f2158f1-1d53-414f-a6ae-215affb7f7b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:35.028509 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4f2158f1-1d53-414f-a6ae-215affb7f7b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:35.028983 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4f2158f1-1d53-414f-a6ae-215affb7f7b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:35.079061 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-5e3b3a26-432a-4708-8118-c9424cccc01c req-3c81aa9e-d3e2-49c6-8d9c-ba774d4f999d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377df57f-c46c-4107-99f6-3d8ce8707e39", "tag": "9f418fcd-8e98-4ba1-96ee-1e27e32eb165"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:35.096963 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-5e3b3a26-432a-4708-8118-c9424cccc01c req-3c81aa9e-d3e2-49c6-8d9c-ba774d4f999d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:35.097931 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-5e3b3a26-432a-4708-8118-c9424cccc01c req-3c81aa9e-d3e2-49c6-8d9c-ba774d4f999d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:35.117560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-5e3b3a26-432a-4708-8118-c9424cccc01c req-3c81aa9e-d3e2-49c6-8d9c-ba774d4f999d service nova] Creating event network-changed:9f418fcd-8e98-4ba1-96ee-1e27e32eb165 for instance 377df57f-c46c-4107-99f6-3d8ce8707e39 on hv-cinder-84330 May 25 17:11:35.124965 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-5e3b3a26-432a-4708-8118-c9424cccc01c req-3c81aa9e-d3e2-49c6-8d9c-ba774d4f999d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048767 May 25 17:11:35.125931 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 154/320] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:11:35.266495 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1bce0acb-9d52-4efb-9f3f-26067cb041d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:35.267476 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1bce0acb-9d52-4efb-9f3f-26067cb041d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:35.275323 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bce0acb-9d52-4efb-9f3f-26067cb041d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:35.276216 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bce0acb-9d52-4efb-9f3f-26067cb041d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:35.277184 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bce0acb-9d52-4efb-9f3f-26067cb041d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:35.277938 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bce0acb-9d52-4efb-9f3f-26067cb041d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:35.429540 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1bce0acb-9d52-4efb-9f3f-26067cb041d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:35.443618 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1bce0acb-9d52-4efb-9f3f-26067cb041d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1237 microversion: 2.1 time: 0.185261 May 25 17:11:35.444214 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 155/321] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:35 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1237 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:35.463419 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1532100723", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "networks": [{"uuid": "2300e90b-d27f-4f3f-bb1d-d819acec0222"}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:35.572443 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] validate_networks() for [('2300e90b-d27f-4f3f-bb1d-d819acec0222', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:11:35.631204 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4f2158f1-1d53-414f-a6ae-215affb7f7b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:35.658816 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4f2158f1-1d53-414f-a6ae-215affb7f7b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:35.660489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4f2158f1-1d53-414f-a6ae-215affb7f7b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:35.664505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4f2158f1-1d53-414f-a6ae-215affb7f7b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.650028 May 25 17:11:35.667532 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 167/322] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:35 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:35.676132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-89506542-f84d-417f-a137-00df5cae0f37 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:35.678795 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-89506542-f84d-417f-a137-00df5cae0f37 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:35.694651 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89506542-f84d-417f-a137-00df5cae0f37 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:35.698890 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89506542-f84d-417f-a137-00df5cae0f37 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:35.699912 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89506542-f84d-417f-a137-00df5cae0f37 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:35.700531 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89506542-f84d-417f-a137-00df5cae0f37 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:36.042001 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-89506542-f84d-417f-a137-00df5cae0f37 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:36.064697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-89506542-f84d-417f-a137-00df5cae0f37 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.392143 May 25 17:11:36.071682 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 168/323] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:35 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:36.461906 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-dcb4c9a7-9879-4659-a9e0-7e4a9b4cf140 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Action: 'create', calling method: .version_select at 0x7f3d4e2f21f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1368124714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTOmEJEyRxcrUTbKXJ6vm81jRSbtDdtNF5An32TpYDHkt1EjgvafvcTH7snzpVDWuXC4Djm26gx2issuV2hGA+efXA07klQO9UClswycvGajWlK1DIIsSy+yq27L7ycSg=="}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:36.480587 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-dcb4c9a7-9879-4659-a9e0-7e4a9b4cf140 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Getting quotas for project 1d67075f4eaf4908acb0c2763153b81c. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:11:36.485791 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-dcb4c9a7-9879-4659-a9e0-7e4a9b4cf140 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Getting quotas for user 96f7eb5295ad40df898f93f1505a7df7 and project 1d67075f4eaf4908acb0c2763153b81c. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:11:36.529708 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-dcb4c9a7-9879-4659-a9e0-7e4a9b4cf140 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.456620 May 25 17:11:36.531457 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 169/324] 10.222.0.31 () {60 vars in 1158 bytes} [Wed May 25 17:11:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:36.541478 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-44db7902-e64e-47b2-9427-68f7a0c8dae1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:36.542102 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-44db7902-e64e-47b2-9427-68f7a0c8dae1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:36.551486 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44db7902-e64e-47b2-9427-68f7a0c8dae1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:36.551991 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44db7902-e64e-47b2-9427-68f7a0c8dae1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:36.553368 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44db7902-e64e-47b2-9427-68f7a0c8dae1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:36.553826 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44db7902-e64e-47b2-9427-68f7a0c8dae1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:36.614573 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:11:36.615746 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:11:36.616472 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:11:36.617078 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:11:36.617819 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:11:36.639056 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:36.643796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:36.645392 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:36.648320 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:36.704903 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Getting quotas for project 0f97d685bab047d8bbcd4c9e804f7d82. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:11:36.709885 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Getting quotas for user 483fc20c75df406983982ee5a21b4913 and project 0f97d685bab047d8bbcd4c9e804f7d82. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:11:36.724088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:11:36.726545 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:11:36.784433 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-44db7902-e64e-47b2-9427-68f7a0c8dae1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:36.792799 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-44db7902-e64e-47b2-9427-68f7a0c8dae1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1370 microversion: 2.1 time: 0.260005 May 25 17:11:36.793356 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 170/325] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:36 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:36.807366 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-199eb10f-c508-4fda-a207-4337662504cf tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:36.808442 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-199eb10f-c508-4fda-a207-4337662504cf tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:36.817980 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-199eb10f-c508-4fda-a207-4337662504cf tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:36.819822 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-199eb10f-c508-4fda-a207-4337662504cf tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:36.820798 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-199eb10f-c508-4fda-a207-4337662504cf tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:36.821383 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-199eb10f-c508-4fda-a207-4337662504cf tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:36.855226 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1776ccf7-03e3-4309-aa3e-04906628cd20 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.397688 May 25 17:11:36.857280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 156/326] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:11:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:11:36.866257 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b5a4771b-b73f-4660-aa1a-601cdcacb410 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:36.871856 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b5a4771b-b73f-4660-aa1a-601cdcacb410 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:36.882768 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b5a4771b-b73f-4660-aa1a-601cdcacb410 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:36.883510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b5a4771b-b73f-4660-aa1a-601cdcacb410 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:36.885653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b5a4771b-b73f-4660-aa1a-601cdcacb410 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:36.886338 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b5a4771b-b73f-4660-aa1a-601cdcacb410 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:36.951944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-199eb10f-c508-4fda-a207-4337662504cf tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:36.963824 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-199eb10f-c508-4fda-a207-4337662504cf tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1299 microversion: 2.1 time: 0.168899 May 25 17:11:36.976341 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 171/327] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:36 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:36.982776 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-44cc467d-044a-4649-a64a-b94ff7f20fcd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:36.988858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-44cc467d-044a-4649-a64a-b94ff7f20fcd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:37.067493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-44cc467d-044a-4649-a64a-b94ff7f20fcd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:37.080627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-44cc467d-044a-4649-a64a-b94ff7f20fcd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1219 microversion: 2.1 time: 0.101856 May 25 17:11:37.097792 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 172/328] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:36 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:37.111314 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-dd863af5-664f-4fdb-8789-3eac9fd2fca7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:37.112170 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-dd863af5-664f-4fdb-8789-3eac9fd2fca7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:37.127835 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-dd863af5-664f-4fdb-8789-3eac9fd2fca7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:37.128301 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-dd863af5-664f-4fdb-8789-3eac9fd2fca7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:37.129113 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-dd863af5-664f-4fdb-8789-3eac9fd2fca7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:37.146425 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-dd863af5-664f-4fdb-8789-3eac9fd2fca7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:37.347232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b5a4771b-b73f-4660-aa1a-601cdcacb410 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:37.362193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b5a4771b-b73f-4660-aa1a-601cdcacb410 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:37.368234 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b5a4771b-b73f-4660-aa1a-601cdcacb410 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:37.369910 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b5a4771b-b73f-4660-aa1a-601cdcacb410 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.511559 May 25 17:11:37.370760 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 157/329] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:36 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:37.470146 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-dd863af5-664f-4fdb-8789-3eac9fd2fca7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:37.480525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-dd863af5-664f-4fdb-8789-3eac9fd2fca7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.381501 May 25 17:11:37.481577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 173/330] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:37 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:37.810149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b42152fe-d162-4073-8894-05f3d2ea63d0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:37.812067 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b42152fe-d162-4073-8894-05f3d2ea63d0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:37.824445 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b42152fe-d162-4073-8894-05f3d2ea63d0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:37.837001 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b42152fe-d162-4073-8894-05f3d2ea63d0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:37.838261 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b42152fe-d162-4073-8894-05f3d2ea63d0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:37.839493 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b42152fe-d162-4073-8894-05f3d2ea63d0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:37.983017 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-313647d4-b79c-41e1-9d28-ee9696e6e4d3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:37.985353 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-313647d4-b79c-41e1-9d28-ee9696e6e4d3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:38.001173 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-313647d4-b79c-41e1-9d28-ee9696e6e4d3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:38.002816 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-313647d4-b79c-41e1-9d28-ee9696e6e4d3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:38.004376 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-313647d4-b79c-41e1-9d28-ee9696e6e4d3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:38.006772 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-313647d4-b79c-41e1-9d28-ee9696e6e4d3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:38.253738 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b42152fe-d162-4073-8894-05f3d2ea63d0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:38.262276 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b42152fe-d162-4073-8894-05f3d2ea63d0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1370 microversion: 2.1 time: 0.455999 May 25 17:11:38.262870 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 158/331] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:37 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1370 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:38.276776 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c5632827-85f7-4cc3-b29d-2f4cddea3e06 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:38.277674 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c5632827-85f7-4cc3-b29d-2f4cddea3e06 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:38.301380 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c5632827-85f7-4cc3-b29d-2f4cddea3e06 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:38.302333 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c5632827-85f7-4cc3-b29d-2f4cddea3e06 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:38.306046 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c5632827-85f7-4cc3-b29d-2f4cddea3e06 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:38.309227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c5632827-85f7-4cc3-b29d-2f4cddea3e06 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:38.362165 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-313647d4-b79c-41e1-9d28-ee9696e6e4d3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:38.371647 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-313647d4-b79c-41e1-9d28-ee9696e6e4d3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1299 microversion: 2.1 time: 0.393264 May 25 17:11:38.372234 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 174/332] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:37 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1299 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:38.389207 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5e698e36-ec4f-4988-a34c-d394bb668e28 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:38.398018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5e698e36-ec4f-4988-a34c-d394bb668e28 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:38.410586 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5e698e36-ec4f-4988-a34c-d394bb668e28 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:38.411046 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5e698e36-ec4f-4988-a34c-d394bb668e28 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:38.411821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5e698e36-ec4f-4988-a34c-d394bb668e28 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:38.412262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5e698e36-ec4f-4988-a34c-d394bb668e28 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:38.454304 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c5632827-85f7-4cc3-b29d-2f4cddea3e06 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:38.482371 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c5632827-85f7-4cc3-b29d-2f4cddea3e06 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1271 microversion: 2.1 time: 0.209456 May 25 17:11:38.484287 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 159/333] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:38 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:38.513326 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-287ddd0c-9c30-4de2-a4ca-f85190501d8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:38.514026 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-287ddd0c-9c30-4de2-a4ca-f85190501d8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:38.524872 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-287ddd0c-9c30-4de2-a4ca-f85190501d8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:38.525668 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-287ddd0c-9c30-4de2-a4ca-f85190501d8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:38.527023 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-287ddd0c-9c30-4de2-a4ca-f85190501d8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:38.527720 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-287ddd0c-9c30-4de2-a4ca-f85190501d8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:38.901048 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5e698e36-ec4f-4988-a34c-d394bb668e28 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:38.916042 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5e698e36-ec4f-4988-a34c-d394bb668e28 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:38.917616 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5e698e36-ec4f-4988-a34c-d394bb668e28 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:38.923023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5e698e36-ec4f-4988-a34c-d394bb668e28 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.537499 May 25 17:11:38.926730 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 175/334] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:38 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:39.183553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-287ddd0c-9c30-4de2-a4ca-f85190501d8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:39.193473 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-287ddd0c-9c30-4de2-a4ca-f85190501d8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.690810 May 25 17:11:39.198653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 160/335] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:38 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:39.279487 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0b966eae-2490-4456-bc6b-50172d1b746a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:39.281367 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0b966eae-2490-4456-bc6b-50172d1b746a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:39.303832 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b966eae-2490-4456-bc6b-50172d1b746a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:39.306728 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b966eae-2490-4456-bc6b-50172d1b746a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:39.307739 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b966eae-2490-4456-bc6b-50172d1b746a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:39.309501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b966eae-2490-4456-bc6b-50172d1b746a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:39.389101 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ac3ca946-1694-4f48-8cb5-34fa466e6be1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:39.390551 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ac3ca946-1694-4f48-8cb5-34fa466e6be1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:39.407961 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ac3ca946-1694-4f48-8cb5-34fa466e6be1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:39.408813 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ac3ca946-1694-4f48-8cb5-34fa466e6be1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:39.414573 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ac3ca946-1694-4f48-8cb5-34fa466e6be1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:39.415280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ac3ca946-1694-4f48-8cb5-34fa466e6be1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:39.427106 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:39.817806 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0b966eae-2490-4456-bc6b-50172d1b746a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:39.836453 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0b966eae-2490-4456-bc6b-50172d1b746a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1370 microversion: 2.1 time: 0.560668 May 25 17:11:39.848306 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 176/336] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:39 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1370 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:39.854470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f320de88-405a-48f4-bd47-6b6852462a9b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:39.855506 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f320de88-405a-48f4-bd47-6b6852462a9b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:39.863652 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f320de88-405a-48f4-bd47-6b6852462a9b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:39.864781 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f320de88-405a-48f4-bd47-6b6852462a9b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:39.865807 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f320de88-405a-48f4-bd47-6b6852462a9b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:39.866483 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f320de88-405a-48f4-bd47-6b6852462a9b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:39.894858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=100 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:39.992667 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f320de88-405a-48f4-bd47-6b6852462a9b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:40.003392 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f320de88-405a-48f4-bd47-6b6852462a9b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1277 microversion: 2.1 time: 0.153396 May 25 17:11:40.006732 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 177/337] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:39 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:40.012850 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3b94a49c-7999-4258-95a0-6229d1fd8eef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:40.014074 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3b94a49c-7999-4258-95a0-6229d1fd8eef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:40.035108 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3b94a49c-7999-4258-95a0-6229d1fd8eef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:40.036321 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3b94a49c-7999-4258-95a0-6229d1fd8eef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:40.037693 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3b94a49c-7999-4258-95a0-6229d1fd8eef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:40.038288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3b94a49c-7999-4258-95a0-6229d1fd8eef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:40.281944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3b94a49c-7999-4258-95a0-6229d1fd8eef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:40.292859 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3b94a49c-7999-4258-95a0-6229d1fd8eef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:40.295374 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3b94a49c-7999-4258-95a0-6229d1fd8eef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:40.298521 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3b94a49c-7999-4258-95a0-6229d1fd8eef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.290491 May 25 17:11:40.299251 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 178/338] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:40 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:40.320871 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-203ecf23-a264-4821-a7e1-2c57f007902f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:40.328398 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-203ecf23-a264-4821-a7e1-2c57f007902f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:40.346573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-203ecf23-a264-4821-a7e1-2c57f007902f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:40.348259 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-203ecf23-a264-4821-a7e1-2c57f007902f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:40.349843 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-203ecf23-a264-4821-a7e1-2c57f007902f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:40.351721 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-203ecf23-a264-4821-a7e1-2c57f007902f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:40.699870 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ac3ca946-1694-4f48-8cb5-34fa466e6be1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:40.715433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ac3ca946-1694-4f48-8cb5-34fa466e6be1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 1.325451 May 25 17:11:40.715912 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-203ecf23-a264-4821-a7e1-2c57f007902f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:40.728407 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 161/339] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:39 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:40.730273 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-203ecf23-a264-4821-a7e1-2c57f007902f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.412214 May 25 17:11:40.750865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 179/340] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:40 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:40.855570 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d7f5e7e7-f118-4797-a6a5-2b333672a661 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:40.857840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d7f5e7e7-f118-4797-a6a5-2b333672a661 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:40.887676 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d7f5e7e7-f118-4797-a6a5-2b333672a661 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:40.889037 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d7f5e7e7-f118-4797-a6a5-2b333672a661 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:40.896001 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d7f5e7e7-f118-4797-a6a5-2b333672a661 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:40.896767 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d7f5e7e7-f118-4797-a6a5-2b333672a661 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:41.025598 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3518dcf2-c6e8-4bf4-aa7b-b821eb6700a7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:41.026295 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3518dcf2-c6e8-4bf4-aa7b-b821eb6700a7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:41.047751 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3518dcf2-c6e8-4bf4-aa7b-b821eb6700a7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:41.048471 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3518dcf2-c6e8-4bf4-aa7b-b821eb6700a7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:41.051925 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3518dcf2-c6e8-4bf4-aa7b-b821eb6700a7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:41.052654 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3518dcf2-c6e8-4bf4-aa7b-b821eb6700a7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:41.222784 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3518dcf2-c6e8-4bf4-aa7b-b821eb6700a7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:41.233043 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3518dcf2-c6e8-4bf4-aa7b-b821eb6700a7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1277 microversion: 2.1 time: 0.210850 May 25 17:11:41.237788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 180/341] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:41 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:41.320084 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9b90baac-1f77-48d5-97fb-5887baf2b755 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:41.321782 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-9b90baac-1f77-48d5-97fb-5887baf2b755 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:41.333051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9b90baac-1f77-48d5-97fb-5887baf2b755 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:41.333504 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9b90baac-1f77-48d5-97fb-5887baf2b755 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:41.334542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9b90baac-1f77-48d5-97fb-5887baf2b755 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:41.334875 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9b90baac-1f77-48d5-97fb-5887baf2b755 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:41.736891 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9b90baac-1f77-48d5-97fb-5887baf2b755 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:41.752729 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9b90baac-1f77-48d5-97fb-5887baf2b755 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:41.754648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9b90baac-1f77-48d5-97fb-5887baf2b755 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:41.756648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9b90baac-1f77-48d5-97fb-5887baf2b755 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.440591 May 25 17:11:41.771885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 181/342] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:41 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:41.789221 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-8fff7dbd-6f80-4969-987d-df40deb800ab req-ab3a1a1d-db65-4895-8b77-366c2312c2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377df57f-c46c-4107-99f6-3d8ce8707e39", "name": "network-vif-plugged", "status": "completed", "tag": "9f418fcd-8e98-4ba1-96ee-1e27e32eb165"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:41.815257 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-8fff7dbd-6f80-4969-987d-df40deb800ab req-ab3a1a1d-db65-4895-8b77-366c2312c2f3 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:41.817488 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-8fff7dbd-6f80-4969-987d-df40deb800ab req-ab3a1a1d-db65-4895-8b77-366c2312c2f3 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:41.860343 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-8fff7dbd-6f80-4969-987d-df40deb800ab req-ab3a1a1d-db65-4895-8b77-366c2312c2f3 service nova] Creating event network-vif-plugged:9f418fcd-8e98-4ba1-96ee-1e27e32eb165 for instance 377df57f-c46c-4107-99f6-3d8ce8707e39 on hv-cinder-84330 May 25 17:11:41.906794 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-8fff7dbd-6f80-4969-987d-df40deb800ab req-ab3a1a1d-db65-4895-8b77-366c2312c2f3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132721 May 25 17:11:41.910663 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 182/343] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:41.917550 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d8505b70-bbae-443f-ab5b-b1732875954d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:41.918503 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d8505b70-bbae-443f-ab5b-b1732875954d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:41.940089 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d8505b70-bbae-443f-ab5b-b1732875954d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:41.940867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d8505b70-bbae-443f-ab5b-b1732875954d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:41.942269 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d8505b70-bbae-443f-ab5b-b1732875954d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:41.944498 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d8505b70-bbae-443f-ab5b-b1732875954d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:42.170348 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d8505b70-bbae-443f-ab5b-b1732875954d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:42.196048 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d7f5e7e7-f118-4797-a6a5-2b333672a661 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:42.200057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d8505b70-bbae-443f-ab5b-b1732875954d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.287499 May 25 17:11:42.200825 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 183/344] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:41 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:42.215653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d7f5e7e7-f118-4797-a6a5-2b333672a661 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1370 microversion: 2.1 time: 1.363649 May 25 17:11:42.215653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 162/345] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:40 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1370 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:42.241092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-20db6847-2cf8-4750-958e-03064e070413 req-88351018-3ee2-493f-b7f2-a2a298c5a701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "145de36f-e49b-4444-85c5-4a207d31619b", "tag": "59d8b30c-3e18-47c8-ad7a-a6090706a8e6"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:42.252421 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-20db6847-2cf8-4750-958e-03064e070413 req-88351018-3ee2-493f-b7f2-a2a298c5a701 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:42.253059 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2525032a-2579-43a2-a406-d97b63f96cfe tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:42.253517 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-20db6847-2cf8-4750-958e-03064e070413 req-88351018-3ee2-493f-b7f2-a2a298c5a701 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:42.255105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2525032a-2579-43a2-a406-d97b63f96cfe tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:42.268492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-20db6847-2cf8-4750-958e-03064e070413 req-88351018-3ee2-493f-b7f2-a2a298c5a701 service nova] Creating event network-changed:59d8b30c-3e18-47c8-ad7a-a6090706a8e6 for instance 145de36f-e49b-4444-85c5-4a207d31619b on hv-cinder-84330 May 25 17:11:42.274090 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-20db6847-2cf8-4750-958e-03064e070413 req-88351018-3ee2-493f-b7f2-a2a298c5a701 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039921 May 25 17:11:42.275014 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 163/346] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:42.280434 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2b2dcb01-e721-4cde-afd9-5c4b31ca90cd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:42.281375 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2b2dcb01-e721-4cde-afd9-5c4b31ca90cd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:42.293516 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b2dcb01-e721-4cde-afd9-5c4b31ca90cd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:42.293976 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b2dcb01-e721-4cde-afd9-5c4b31ca90cd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:42.294264 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2525032a-2579-43a2-a406-d97b63f96cfe tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:42.294754 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b2dcb01-e721-4cde-afd9-5c4b31ca90cd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:42.295904 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2525032a-2579-43a2-a406-d97b63f96cfe tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:42.297749 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b2dcb01-e721-4cde-afd9-5c4b31ca90cd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:42.307108 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2525032a-2579-43a2-a406-d97b63f96cfe tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:42.307718 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2525032a-2579-43a2-a406-d97b63f96cfe tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:42.459032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2b2dcb01-e721-4cde-afd9-5c4b31ca90cd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:42.466778 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2b2dcb01-e721-4cde-afd9-5c4b31ca90cd tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1277 microversion: 2.1 time: 0.190363 May 25 17:11:42.483596 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 164/347] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:42 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:42.659524 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2525032a-2579-43a2-a406-d97b63f96cfe tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:42.671600 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2525032a-2579-43a2-a406-d97b63f96cfe tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.468715 May 25 17:11:42.674061 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 184/348] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:42 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:42.780441 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ebff0fe9-3623-4675-87dd-79b7adc55da1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:42.781769 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ebff0fe9-3623-4675-87dd-79b7adc55da1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:42.789030 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ebff0fe9-3623-4675-87dd-79b7adc55da1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:42.789815 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ebff0fe9-3623-4675-87dd-79b7adc55da1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:42.790814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ebff0fe9-3623-4675-87dd-79b7adc55da1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:42.791495 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ebff0fe9-3623-4675-87dd-79b7adc55da1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:43.083114 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ebff0fe9-3623-4675-87dd-79b7adc55da1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:43.103901 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ebff0fe9-3623-4675-87dd-79b7adc55da1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:43.112031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ebff0fe9-3623-4675-87dd-79b7adc55da1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:43.115576 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ebff0fe9-3623-4675-87dd-79b7adc55da1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.339938 May 25 17:11:43.117042 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 165/349] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:42 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:43.221030 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ad93a1dd-2afe-4448-a27a-ce284b257339 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:43.221856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ad93a1dd-2afe-4448-a27a-ce284b257339 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:43.235429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4e935932-53dd-4527-a6e9-0c49e27f7989 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:43.237351 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4e935932-53dd-4527-a6e9-0c49e27f7989 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:43.251703 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ad93a1dd-2afe-4448-a27a-ce284b257339 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:43.252067 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4e935932-53dd-4527-a6e9-0c49e27f7989 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:43.252626 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4e935932-53dd-4527-a6e9-0c49e27f7989 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:43.253634 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ad93a1dd-2afe-4448-a27a-ce284b257339 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:43.253964 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4e935932-53dd-4527-a6e9-0c49e27f7989 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:43.255219 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4e935932-53dd-4527-a6e9-0c49e27f7989 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:43.255610 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ad93a1dd-2afe-4448-a27a-ce284b257339 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:43.256719 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ad93a1dd-2afe-4448-a27a-ce284b257339 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:43.529190 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4e935932-53dd-4527-a6e9-0c49e27f7989 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:43.545259 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4e935932-53dd-4527-a6e9-0c49e27f7989 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1370 microversion: 2.1 time: 0.317367 May 25 17:11:43.554542 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 166/350] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:43 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1370 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:43.568767 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c3f6bec3-1750-4e22-9081-bdae720dce6f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:43.569486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c3f6bec3-1750-4e22-9081-bdae720dce6f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:43.575603 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c3f6bec3-1750-4e22-9081-bdae720dce6f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:43.576050 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c3f6bec3-1750-4e22-9081-bdae720dce6f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:43.577437 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c3f6bec3-1750-4e22-9081-bdae720dce6f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:43.577875 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c3f6bec3-1750-4e22-9081-bdae720dce6f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:43.590658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ad93a1dd-2afe-4448-a27a-ce284b257339 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:43.602131 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ad93a1dd-2afe-4448-a27a-ce284b257339 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.386591 May 25 17:11:43.602914 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 185/351] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:43 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:43.697219 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-704c6ad6-ed54-4388-aa19-6e31b7b77b3e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:43.699169 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-704c6ad6-ed54-4388-aa19-6e31b7b77b3e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:43.708000 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-704c6ad6-ed54-4388-aa19-6e31b7b77b3e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:43.708520 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-704c6ad6-ed54-4388-aa19-6e31b7b77b3e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:43.709559 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-704c6ad6-ed54-4388-aa19-6e31b7b77b3e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:43.710227 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-704c6ad6-ed54-4388-aa19-6e31b7b77b3e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:43.799793 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c3f6bec3-1750-4e22-9081-bdae720dce6f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:43.811970 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c3f6bec3-1750-4e22-9081-bdae720dce6f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.255630 May 25 17:11:43.812566 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 167/352] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:43 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:43.912668 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-704c6ad6-ed54-4388-aa19-6e31b7b77b3e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:43.926869 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-704c6ad6-ed54-4388-aa19-6e31b7b77b3e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.239120 May 25 17:11:43.946991 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 186/353] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:43 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:44.136005 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8dbf2317-c31f-4c9b-8a1b-7901278af7b2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:44.137329 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8dbf2317-c31f-4c9b-8a1b-7901278af7b2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:44.145302 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8dbf2317-c31f-4c9b-8a1b-7901278af7b2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:44.146008 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8dbf2317-c31f-4c9b-8a1b-7901278af7b2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:44.147013 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8dbf2317-c31f-4c9b-8a1b-7901278af7b2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:44.147659 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8dbf2317-c31f-4c9b-8a1b-7901278af7b2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:44.339593 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8dbf2317-c31f-4c9b-8a1b-7901278af7b2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:44.350822 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8dbf2317-c31f-4c9b-8a1b-7901278af7b2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:44.352639 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8dbf2317-c31f-4c9b-8a1b-7901278af7b2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:44.353921 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8dbf2317-c31f-4c9b-8a1b-7901278af7b2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.222408 May 25 17:11:44.365184 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 168/354] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:44 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:44.582650 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6b3a4618-f794-4978-a904-05883a6629c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:44.583241 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6b3a4618-f794-4978-a904-05883a6629c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:44.592251 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6b3a4618-f794-4978-a904-05883a6629c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:44.592997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6b3a4618-f794-4978-a904-05883a6629c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:44.594045 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6b3a4618-f794-4978-a904-05883a6629c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:44.595216 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6b3a4618-f794-4978-a904-05883a6629c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:44.619329 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8886eb25-dd84-4f2d-a168-14dc595afaa1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:44.620257 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8886eb25-dd84-4f2d-a168-14dc595afaa1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:44.636465 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8886eb25-dd84-4f2d-a168-14dc595afaa1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:44.636952 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8886eb25-dd84-4f2d-a168-14dc595afaa1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:44.637747 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8886eb25-dd84-4f2d-a168-14dc595afaa1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:44.638330 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8886eb25-dd84-4f2d-a168-14dc595afaa1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:44.914964 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6b3a4618-f794-4978-a904-05883a6629c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:44.931539 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6b3a4618-f794-4978-a904-05883a6629c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1370 microversion: 2.1 time: 0.371532 May 25 17:11:44.939177 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 187/355] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:44 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1370 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:44.946727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8886eb25-dd84-4f2d-a168-14dc595afaa1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:44.955191 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a5f98ec0-15a2-4109-8d36-b77c0c1c9346 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:44.956018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a5f98ec0-15a2-4109-8d36-b77c0c1c9346 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:44.956152 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8886eb25-dd84-4f2d-a168-14dc595afaa1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.340732 May 25 17:11:44.960240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 169/356] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:44 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:44.963185 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a5f98ec0-15a2-4109-8d36-b77c0c1c9346 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:44.963912 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a5f98ec0-15a2-4109-8d36-b77c0c1c9346 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:44.964960 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a5f98ec0-15a2-4109-8d36-b77c0c1c9346 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:44.965636 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a5f98ec0-15a2-4109-8d36-b77c0c1c9346 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:44.972908 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f9975613-91e2-4f52-82cc-a3e80ab9d79f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:44.973557 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f9975613-91e2-4f52-82cc-a3e80ab9d79f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:44.993444 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9975613-91e2-4f52-82cc-a3e80ab9d79f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:44.993894 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9975613-91e2-4f52-82cc-a3e80ab9d79f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:44.994676 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9975613-91e2-4f52-82cc-a3e80ab9d79f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:44.995102 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9975613-91e2-4f52-82cc-a3e80ab9d79f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:45.217020 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a5f98ec0-15a2-4109-8d36-b77c0c1c9346 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:45.228138 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a5f98ec0-15a2-4109-8d36-b77c0c1c9346 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.277692 May 25 17:11:45.239024 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 188/357] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:44 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:45.334257 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f9975613-91e2-4f52-82cc-a3e80ab9d79f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:45.343558 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f9975613-91e2-4f52-82cc-a3e80ab9d79f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.381753 May 25 17:11:45.344198 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 170/358] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:44 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:45.376070 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a3a493d9-aa20-4056-b153-1ad7c6687a05 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:45.376778 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a3a493d9-aa20-4056-b153-1ad7c6687a05 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:45.391907 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a3a493d9-aa20-4056-b153-1ad7c6687a05 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:45.392432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a3a493d9-aa20-4056-b153-1ad7c6687a05 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:45.393367 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a3a493d9-aa20-4056-b153-1ad7c6687a05 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:45.393891 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a3a493d9-aa20-4056-b153-1ad7c6687a05 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:45.524276 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-4724f042-562c-4702-9692-458fb9c9d048 req-ae9eb510-f904-4e78-a1b4-41715e40d29f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eac90cb-0606-4589-b405-8d607816944a", "tag": "15213f99-cfc9-459a-abff-c83378d5b919"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:45.552972 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4724f042-562c-4702-9692-458fb9c9d048 req-ae9eb510-f904-4e78-a1b4-41715e40d29f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:45.553791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4724f042-562c-4702-9692-458fb9c9d048 req-ae9eb510-f904-4e78-a1b4-41715e40d29f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:45.575871 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-4724f042-562c-4702-9692-458fb9c9d048 req-ae9eb510-f904-4e78-a1b4-41715e40d29f service nova] Creating event network-changed:15213f99-cfc9-459a-abff-c83378d5b919 for instance 7eac90cb-0606-4589-b405-8d607816944a on hv-cinder-84330 May 25 17:11:45.581500 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a3a493d9-aa20-4056-b153-1ad7c6687a05 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:45.602824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-4724f042-562c-4702-9692-458fb9c9d048 req-ae9eb510-f904-4e78-a1b4-41715e40d29f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083729 May 25 17:11:45.608158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 171/359] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:11:45.617904 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a3a493d9-aa20-4056-b153-1ad7c6687a05 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:45.629598 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a3a493d9-aa20-4056-b153-1ad7c6687a05 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:45.635140 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a3a493d9-aa20-4056-b153-1ad7c6687a05 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.266924 May 25 17:11:45.646557 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 189/360] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:45 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:45.958154 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5b64dceb-e7de-45af-b5d7-8cd8ee64077f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:45.959463 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5b64dceb-e7de-45af-b5d7-8cd8ee64077f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:45.972126 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b64dceb-e7de-45af-b5d7-8cd8ee64077f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:45.972897 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b64dceb-e7de-45af-b5d7-8cd8ee64077f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:45.973928 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b64dceb-e7de-45af-b5d7-8cd8ee64077f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:45.974519 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b64dceb-e7de-45af-b5d7-8cd8ee64077f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:45.975596 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7b047163-bb39-40f2-81a5-83ada189ed0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:45.976218 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7b047163-bb39-40f2-81a5-83ada189ed0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:45.983841 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7b047163-bb39-40f2-81a5-83ada189ed0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:45.984608 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7b047163-bb39-40f2-81a5-83ada189ed0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:45.985413 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7b047163-bb39-40f2-81a5-83ada189ed0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:45.985841 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7b047163-bb39-40f2-81a5-83ada189ed0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:46.163258 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7b047163-bb39-40f2-81a5-83ada189ed0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:46.175592 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7b047163-bb39-40f2-81a5-83ada189ed0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.205323 May 25 17:11:46.179232 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 190/361] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:45 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:46.189746 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5b64dceb-e7de-45af-b5d7-8cd8ee64077f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:46.199327 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5b64dceb-e7de-45af-b5d7-8cd8ee64077f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1565 microversion: 2.1 time: 0.246094 May 25 17:11:46.200032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 172/362] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:45 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1565 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:46.219018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e2c8c585-8939-4a9d-bfd6-396865982750 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:46.219585 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e2c8c585-8939-4a9d-bfd6-396865982750 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:46.226005 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2c8c585-8939-4a9d-bfd6-396865982750 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:46.226526 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2c8c585-8939-4a9d-bfd6-396865982750 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:46.227762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2c8c585-8939-4a9d-bfd6-396865982750 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:46.228273 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2c8c585-8939-4a9d-bfd6-396865982750 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:46.248141 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-73a0f9a3-7c3c-4c9e-988b-e397e0a76953 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:46.250613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-73a0f9a3-7c3c-4c9e-988b-e397e0a76953 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:46.257329 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73a0f9a3-7c3c-4c9e-988b-e397e0a76953 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:46.258081 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73a0f9a3-7c3c-4c9e-988b-e397e0a76953 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:46.259027 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73a0f9a3-7c3c-4c9e-988b-e397e0a76953 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:46.259617 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73a0f9a3-7c3c-4c9e-988b-e397e0a76953 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:46.338420 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e2c8c585-8939-4a9d-bfd6-396865982750 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123686 May 25 17:11:46.338420 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 191/363] 10.222.0.31 () {58 vars in 1274 bytes} [Wed May 25 17:11:46 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:46.361523 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7d8a2e69-b612-4540-8ad9-ba8d6869a759 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:46.362005 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7d8a2e69-b612-4540-8ad9-ba8d6869a759 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:46.369205 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7d8a2e69-b612-4540-8ad9-ba8d6869a759 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:46.369657 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7d8a2e69-b612-4540-8ad9-ba8d6869a759 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:46.370432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7d8a2e69-b612-4540-8ad9-ba8d6869a759 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:46.370868 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7d8a2e69-b612-4540-8ad9-ba8d6869a759 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:46.443841 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-73a0f9a3-7c3c-4c9e-988b-e397e0a76953 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:46.461824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-73a0f9a3-7c3c-4c9e-988b-e397e0a76953 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.219567 May 25 17:11:46.468930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 173/364] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:46 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:46.654251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d02a1273-6a6d-4d9b-869c-2102e776fee5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:46.656085 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d02a1273-6a6d-4d9b-869c-2102e776fee5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:46.665181 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d02a1273-6a6d-4d9b-869c-2102e776fee5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:46.667374 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7d8a2e69-b612-4540-8ad9-ba8d6869a759 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:46.668539 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d02a1273-6a6d-4d9b-869c-2102e776fee5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:46.670700 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d02a1273-6a6d-4d9b-869c-2102e776fee5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:46.671381 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d02a1273-6a6d-4d9b-869c-2102e776fee5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:46.674591 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:46.681354 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7d8a2e69-b612-4540-8ad9-ba8d6869a759 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.323695 May 25 17:11:46.682944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 192/365] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:46 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:46.722601 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=24 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:46.895467 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d02a1273-6a6d-4d9b-869c-2102e776fee5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:46.905912 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d02a1273-6a6d-4d9b-869c-2102e776fee5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:46.907710 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d02a1273-6a6d-4d9b-869c-2102e776fee5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:46.909384 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d02a1273-6a6d-4d9b-869c-2102e776fee5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.259077 May 25 17:11:46.910258 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 174/366] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:46 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:47.196644 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6c3ef231-686b-477f-afd0-8579c27e80ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:47.197290 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6c3ef231-686b-477f-afd0-8579c27e80ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:47.199357 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=6 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:47.206192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6c3ef231-686b-477f-afd0-8579c27e80ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:47.206649 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6c3ef231-686b-477f-afd0-8579c27e80ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:47.207432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6c3ef231-686b-477f-afd0-8579c27e80ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:47.207873 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6c3ef231-686b-477f-afd0-8579c27e80ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:47.464694 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6c3ef231-686b-477f-afd0-8579c27e80ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:47.473735 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6c3ef231-686b-477f-afd0-8579c27e80ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.280811 May 25 17:11:47.473735 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 193/367] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:47 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:47.493001 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ba5dba48-726d-47d2-bd30-d3eaaf761897 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:47.494000 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ba5dba48-726d-47d2-bd30-d3eaaf761897 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:47.501747 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba5dba48-726d-47d2-bd30-d3eaaf761897 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:47.502678 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba5dba48-726d-47d2-bd30-d3eaaf761897 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:47.503463 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba5dba48-726d-47d2-bd30-d3eaaf761897 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:47.504089 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba5dba48-726d-47d2-bd30-d3eaaf761897 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:47.659176 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ba5dba48-726d-47d2-bd30-d3eaaf761897 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:47.666973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ba5dba48-726d-47d2-bd30-d3eaaf761897 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.184198 May 25 17:11:47.667556 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 175/368] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:47 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:47.699367 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-cd55db6f-b967-4b6a-b075-eb277d104f8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:47.699990 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-cd55db6f-b967-4b6a-b075-eb277d104f8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:47.707360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cd55db6f-b967-4b6a-b075-eb277d104f8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:47.707818 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cd55db6f-b967-4b6a-b075-eb277d104f8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:47.708597 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cd55db6f-b967-4b6a-b075-eb277d104f8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:47.709085 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cd55db6f-b967-4b6a-b075-eb277d104f8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:47.864593 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-46b34880-7c2c-43e4-8309-6fdb6988e8ff req-d0b4936d-dea0-4766-b7a1-f84721deea47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377df57f-c46c-4107-99f6-3d8ce8707e39", "tag": "9f418fcd-8e98-4ba1-96ee-1e27e32eb165"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:47.875580 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-46b34880-7c2c-43e4-8309-6fdb6988e8ff req-d0b4936d-dea0-4766-b7a1-f84721deea47 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:47.876296 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-46b34880-7c2c-43e4-8309-6fdb6988e8ff req-d0b4936d-dea0-4766-b7a1-f84721deea47 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:47.893954 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-46b34880-7c2c-43e4-8309-6fdb6988e8ff req-d0b4936d-dea0-4766-b7a1-f84721deea47 service nova] Creating event network-changed:9f418fcd-8e98-4ba1-96ee-1e27e32eb165 for instance 377df57f-c46c-4107-99f6-3d8ce8707e39 on hv-cinder-84330 May 25 17:11:47.899162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-46b34880-7c2c-43e4-8309-6fdb6988e8ff req-d0b4936d-dea0-4766-b7a1-f84721deea47 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038372 May 25 17:11:47.900140 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 176/369] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:11:47.913740 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-cd55db6f-b967-4b6a-b075-eb277d104f8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:47.922354 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-cd55db6f-b967-4b6a-b075-eb277d104f8c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.226871 May 25 17:11:47.923007 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 194/370] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:47 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:47.931956 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7e855fdc-b886-4a24-b9b5-56360b876602 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:47.933115 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7e855fdc-b886-4a24-b9b5-56360b876602 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:47.940150 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7e855fdc-b886-4a24-b9b5-56360b876602 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:47.940626 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7e855fdc-b886-4a24-b9b5-56360b876602 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:47.941422 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7e855fdc-b886-4a24-b9b5-56360b876602 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:47.941863 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7e855fdc-b886-4a24-b9b5-56360b876602 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:48.074265 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7e855fdc-b886-4a24-b9b5-56360b876602 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:48.083035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7e855fdc-b886-4a24-b9b5-56360b876602 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:48.084556 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7e855fdc-b886-4a24-b9b5-56360b876602 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:48.085776 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7e855fdc-b886-4a24-b9b5-56360b876602 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1738 microversion: 2.20 time: 0.158374 May 25 17:11:48.086344 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 177/371] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:47 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:48.492478 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5cb47845-0d43-48a9-bef2-66a56ed844f2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:48.500428 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5cb47845-0d43-48a9-bef2-66a56ed844f2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:48.521132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5cb47845-0d43-48a9-bef2-66a56ed844f2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:48.521597 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5cb47845-0d43-48a9-bef2-66a56ed844f2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:48.522470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5cb47845-0d43-48a9-bef2-66a56ed844f2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:48.522989 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5cb47845-0d43-48a9-bef2-66a56ed844f2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:48.547276 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=100 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:48.685058 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-18b20074-98b1-44d2-8bf8-b5cdd86e669e tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:48.685691 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-18b20074-98b1-44d2-8bf8-b5cdd86e669e tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:48.700447 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18b20074-98b1-44d2-8bf8-b5cdd86e669e tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:48.701136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18b20074-98b1-44d2-8bf8-b5cdd86e669e tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:48.702940 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18b20074-98b1-44d2-8bf8-b5cdd86e669e tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:48.703547 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18b20074-98b1-44d2-8bf8-b5cdd86e669e tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:48.761716 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5cb47845-0d43-48a9-bef2-66a56ed844f2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:48.773677 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5cb47845-0d43-48a9-bef2-66a56ed844f2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.287656 May 25 17:11:48.774556 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 195/372] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:48 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:48.940017 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e9dd2b4a-b16f-41d1-ab8c-22933ee83e48 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:48.940940 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e9dd2b4a-b16f-41d1-ab8c-22933ee83e48 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:48.948742 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e9dd2b4a-b16f-41d1-ab8c-22933ee83e48 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:48.949510 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e9dd2b4a-b16f-41d1-ab8c-22933ee83e48 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:48.950568 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e9dd2b4a-b16f-41d1-ab8c-22933ee83e48 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:48.954197 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e9dd2b4a-b16f-41d1-ab8c-22933ee83e48 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:48.995337 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-18b20074-98b1-44d2-8bf8-b5cdd86e669e tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:49.009794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-18b20074-98b1-44d2-8bf8-b5cdd86e669e tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.328418 May 25 17:11:49.010492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 178/373] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:48 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:49.105760 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bf4b2248-43f0-41f7-a44d-39c633c02c4c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:49.106654 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bf4b2248-43f0-41f7-a44d-39c633c02c4c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:49.117302 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bf4b2248-43f0-41f7-a44d-39c633c02c4c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:49.123417 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e9dd2b4a-b16f-41d1-ab8c-22933ee83e48 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:49.135362 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bf4b2248-43f0-41f7-a44d-39c633c02c4c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:49.138623 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bf4b2248-43f0-41f7-a44d-39c633c02c4c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:49.141132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e9dd2b4a-b16f-41d1-ab8c-22933ee83e48 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1722 microversion: 2.1 time: 0.205292 May 25 17:11:49.141678 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bf4b2248-43f0-41f7-a44d-39c633c02c4c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:49.146292 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 196/374] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:48 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:49.297541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bf4b2248-43f0-41f7-a44d-39c633c02c4c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:49.299897 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:49.308268 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bf4b2248-43f0-41f7-a44d-39c633c02c4c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:49.309802 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bf4b2248-43f0-41f7-a44d-39c633c02c4c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:49.311195 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bf4b2248-43f0-41f7-a44d-39c633c02c4c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1720 microversion: 2.20 time: 0.209372 May 25 17:11:49.311861 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 179/375] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:49 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:49.791501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-128385c3-963d-4bfc-8643-10d094188a35 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:49.792793 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-128385c3-963d-4bfc-8643-10d094188a35 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:49.801003 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-128385c3-963d-4bfc-8643-10d094188a35 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:49.801461 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-128385c3-963d-4bfc-8643-10d094188a35 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:49.802303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-128385c3-963d-4bfc-8643-10d094188a35 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:49.802913 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-128385c3-963d-4bfc-8643-10d094188a35 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:49.968181 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-128385c3-963d-4bfc-8643-10d094188a35 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:49.976430 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-128385c3-963d-4bfc-8643-10d094188a35 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.188844 May 25 17:11:49.977191 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 197/376] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:49 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:50.027704 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b52ab727-e82f-41d7-92c3-9e1eff04824f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:50.028370 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b52ab727-e82f-41d7-92c3-9e1eff04824f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:50.035455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b52ab727-e82f-41d7-92c3-9e1eff04824f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:50.035939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b52ab727-e82f-41d7-92c3-9e1eff04824f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:50.036737 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b52ab727-e82f-41d7-92c3-9e1eff04824f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:50.037179 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b52ab727-e82f-41d7-92c3-9e1eff04824f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:50.163797 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1627226a-714d-4140-98e7-3d7593cea37e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:50.164554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1627226a-714d-4140-98e7-3d7593cea37e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:50.171105 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b52ab727-e82f-41d7-92c3-9e1eff04824f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:50.171632 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1627226a-714d-4140-98e7-3d7593cea37e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:50.172160 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1627226a-714d-4140-98e7-3d7593cea37e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:50.173044 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1627226a-714d-4140-98e7-3d7593cea37e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:50.173498 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1627226a-714d-4140-98e7-3d7593cea37e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:50.178672 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b52ab727-e82f-41d7-92c3-9e1eff04824f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.155094 May 25 17:11:50.179253 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 180/377] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:50 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:50.309203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1627226a-714d-4140-98e7-3d7593cea37e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:50.319431 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1627226a-714d-4140-98e7-3d7593cea37e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1699 microversion: 2.1 time: 0.159422 May 25 17:11:50.320015 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 198/378] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:50 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:50.330282 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8c390204-ca41-4fa7-b1cd-6a7817c78ac1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:50.331175 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8c390204-ca41-4fa7-b1cd-6a7817c78ac1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:50.336845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-bdee54f2-e101-4bf3-bb2d-503e8a1db220 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:50.337765 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c390204-ca41-4fa7-b1cd-6a7817c78ac1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:50.338220 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c390204-ca41-4fa7-b1cd-6a7817c78ac1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:50.339142 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c390204-ca41-4fa7-b1cd-6a7817c78ac1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:50.339589 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c390204-ca41-4fa7-b1cd-6a7817c78ac1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:50.343757 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bdee54f2-e101-4bf3-bb2d-503e8a1db220 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:50.344218 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bdee54f2-e101-4bf3-bb2d-503e8a1db220 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:50.406793 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-bdee54f2-e101-4bf3-bb2d-503e8a1db220 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Going to try to start instance {{(pid=117695) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 17:11:50.450976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-bdee54f2-e101-4bf3-bb2d-503e8a1db220 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/action" status: 202 len: 0 microversion: 2.1 time: 0.118516 May 25 17:11:50.451633 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 199/379] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:11:50 2022] POST /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 17:11:50.460003 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d3fb6910-68b7-4d1c-a3a0-9c22189cff56 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:50.460707 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d3fb6910-68b7-4d1c-a3a0-9c22189cff56 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:50.468009 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d3fb6910-68b7-4d1c-a3a0-9c22189cff56 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:50.468550 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d3fb6910-68b7-4d1c-a3a0-9c22189cff56 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:50.470014 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d3fb6910-68b7-4d1c-a3a0-9c22189cff56 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:50.470452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d3fb6910-68b7-4d1c-a3a0-9c22189cff56 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:50.481481 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8c390204-ca41-4fa7-b1cd-6a7817c78ac1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:50.492452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8c390204-ca41-4fa7-b1cd-6a7817c78ac1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:50.494074 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8c390204-ca41-4fa7-b1cd-6a7817c78ac1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:50.495289 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8c390204-ca41-4fa7-b1cd-6a7817c78ac1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1720 microversion: 2.20 time: 0.169417 May 25 17:11:50.495966 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 181/380] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:50 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:50.605589 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d3fb6910-68b7-4d1c-a3a0-9c22189cff56 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:50.614968 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d3fb6910-68b7-4d1c-a3a0-9c22189cff56 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1708 microversion: 2.1 time: 0.158836 May 25 17:11:50.615637 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 200/381] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:50 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:50.994657 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e5437b40-0586-408c-aa0c-7d7d175967ce tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:50.995266 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e5437b40-0586-408c-aa0c-7d7d175967ce tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:51.003019 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5437b40-0586-408c-aa0c-7d7d175967ce tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:51.003472 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5437b40-0586-408c-aa0c-7d7d175967ce tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:51.004318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5437b40-0586-408c-aa0c-7d7d175967ce tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:51.004795 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5437b40-0586-408c-aa0c-7d7d175967ce tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:51.137325 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e5437b40-0586-408c-aa0c-7d7d175967ce tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:51.145328 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e5437b40-0586-408c-aa0c-7d7d175967ce tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.154757 May 25 17:11:51.145895 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 182/382] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:50 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:51.196733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c9736e90-58b6-4451-800e-99f200ee2eff tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:51.197811 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c9736e90-58b6-4451-800e-99f200ee2eff tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:51.204541 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c9736e90-58b6-4451-800e-99f200ee2eff tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:51.205048 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c9736e90-58b6-4451-800e-99f200ee2eff tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:51.206004 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c9736e90-58b6-4451-800e-99f200ee2eff tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:51.206447 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c9736e90-58b6-4451-800e-99f200ee2eff tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:51.345948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-639f2a62-0733-413f-b249-df7ca4d4e5ec req-9551e41d-827b-42d4-9a13-8aa7a639bfcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145de36f-e49b-4444-85c5-4a207d31619b", "name": "network-vif-plugged", "status": "completed", "tag": "59d8b30c-3e18-47c8-ad7a-a6090706a8e6"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:51.355264 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-639f2a62-0733-413f-b249-df7ca4d4e5ec req-9551e41d-827b-42d4-9a13-8aa7a639bfcf service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:51.355744 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-639f2a62-0733-413f-b249-df7ca4d4e5ec req-9551e41d-827b-42d4-9a13-8aa7a639bfcf service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:51.367251 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c9736e90-58b6-4451-800e-99f200ee2eff tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:51.368009 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-639f2a62-0733-413f-b249-df7ca4d4e5ec req-9551e41d-827b-42d4-9a13-8aa7a639bfcf service nova] Creating event network-vif-plugged:59d8b30c-3e18-47c8-ad7a-a6090706a8e6 for instance 145de36f-e49b-4444-85c5-4a207d31619b on hv-cinder-84330 May 25 17:11:51.372935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-639f2a62-0733-413f-b249-df7ca4d4e5ec req-9551e41d-827b-42d4-9a13-8aa7a639bfcf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031481 May 25 17:11:51.373889 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 183/383] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:51.376119 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c9736e90-58b6-4451-800e-99f200ee2eff tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.184284 May 25 17:11:51.376955 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 201/384] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:51 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:51.515420 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1b4d678b-7acc-428c-8f6e-f4e5bcf74448 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:51.516141 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1b4d678b-7acc-428c-8f6e-f4e5bcf74448 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:51.522754 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1b4d678b-7acc-428c-8f6e-f4e5bcf74448 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:51.523207 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1b4d678b-7acc-428c-8f6e-f4e5bcf74448 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:51.524058 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1b4d678b-7acc-428c-8f6e-f4e5bcf74448 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:51.524494 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1b4d678b-7acc-428c-8f6e-f4e5bcf74448 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:51.634491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9fa8efd4-b74d-478a-ab8d-95769502e76e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:51.635504 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-9fa8efd4-b74d-478a-ab8d-95769502e76e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:51.642250 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9fa8efd4-b74d-478a-ab8d-95769502e76e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:51.642695 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9fa8efd4-b74d-478a-ab8d-95769502e76e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:51.643458 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9fa8efd4-b74d-478a-ab8d-95769502e76e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:51.643890 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9fa8efd4-b74d-478a-ab8d-95769502e76e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:51.659006 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1b4d678b-7acc-428c-8f6e-f4e5bcf74448 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:51.667118 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1b4d678b-7acc-428c-8f6e-f4e5bcf74448 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:51.668633 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1b4d678b-7acc-428c-8f6e-f4e5bcf74448 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:51.669822 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1b4d678b-7acc-428c-8f6e-f4e5bcf74448 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1720 microversion: 2.20 time: 0.159807 May 25 17:11:51.670844 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 184/385] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:51 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:51.778789 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9fa8efd4-b74d-478a-ab8d-95769502e76e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:51.787415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9fa8efd4-b74d-478a-ab8d-95769502e76e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1708 microversion: 2.1 time: 0.157125 May 25 17:11:51.787976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 202/386] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:51 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1708 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:52.164736 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fa005c6c-67d3-4b7b-bf38-e322e1a13aba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:52.165465 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fa005c6c-67d3-4b7b-bf38-e322e1a13aba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:52.172979 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa005c6c-67d3-4b7b-bf38-e322e1a13aba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:52.173525 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa005c6c-67d3-4b7b-bf38-e322e1a13aba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:52.174374 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa005c6c-67d3-4b7b-bf38-e322e1a13aba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:52.174818 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa005c6c-67d3-4b7b-bf38-e322e1a13aba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:52.309880 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fa005c6c-67d3-4b7b-bf38-e322e1a13aba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:52.318219 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fa005c6c-67d3-4b7b-bf38-e322e1a13aba tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.157270 May 25 17:11:52.318630 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 185/387] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:52 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:52.393828 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e2dcb08e-4779-45c9-a0f9-8b1245bc0439 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:52.394500 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e2dcb08e-4779-45c9-a0f9-8b1245bc0439 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:52.401085 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2dcb08e-4779-45c9-a0f9-8b1245bc0439 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:52.401540 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2dcb08e-4779-45c9-a0f9-8b1245bc0439 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:52.402314 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2dcb08e-4779-45c9-a0f9-8b1245bc0439 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:52.402761 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2dcb08e-4779-45c9-a0f9-8b1245bc0439 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:52.588645 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e2dcb08e-4779-45c9-a0f9-8b1245bc0439 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:52.602957 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e2dcb08e-4779-45c9-a0f9-8b1245bc0439 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.210864 May 25 17:11:52.604398 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 203/388] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:52 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:52.691782 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-59d825e8-7805-42e1-b318-484ad7834bb7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:52.692710 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-59d825e8-7805-42e1-b318-484ad7834bb7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:52.702041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-59d825e8-7805-42e1-b318-484ad7834bb7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:52.703157 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-59d825e8-7805-42e1-b318-484ad7834bb7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:52.704306 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-59d825e8-7805-42e1-b318-484ad7834bb7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:52.704937 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-59d825e8-7805-42e1-b318-484ad7834bb7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:52.804576 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-16f40204-65d5-4a34-ac65-5079a2cd11b6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:52.805329 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-16f40204-65d5-4a34-ac65-5079a2cd11b6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:52.811757 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-16f40204-65d5-4a34-ac65-5079a2cd11b6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:52.812209 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-16f40204-65d5-4a34-ac65-5079a2cd11b6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:52.813300 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-16f40204-65d5-4a34-ac65-5079a2cd11b6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:52.813975 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-16f40204-65d5-4a34-ac65-5079a2cd11b6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:52.950640 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-16f40204-65d5-4a34-ac65-5079a2cd11b6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:52.959726 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-16f40204-65d5-4a34-ac65-5079a2cd11b6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1708 microversion: 2.1 time: 0.159066 May 25 17:11:52.960487 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 204/389] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:52 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:53.055385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-59d825e8-7805-42e1-b318-484ad7834bb7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:53.065750 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-59d825e8-7805-42e1-b318-484ad7834bb7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:53.067547 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-59d825e8-7805-42e1-b318-484ad7834bb7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:53.069068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-59d825e8-7805-42e1-b318-484ad7834bb7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1723 microversion: 2.20 time: 0.384210 May 25 17:11:53.069717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 186/390] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:52 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:53.088805 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5f606f79-2a39-4a85-9c68-6b80637e2b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b6b799f-87b5-4abf-aaae-2849d806d3ca"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:53.090236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5f606f79-2a39-4a85-9c68-6b80637e2b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:53.098175 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5f606f79-2a39-4a85-9c68-6b80637e2b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.098633 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5f606f79-2a39-4a85-9c68-6b80637e2b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.099413 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5f606f79-2a39-4a85-9c68-6b80637e2b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.099856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5f606f79-2a39-4a85-9c68-6b80637e2b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.336269 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e8e54979-ef27-40e8-8c9d-34b800d069ac tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:53.337086 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e8e54979-ef27-40e8-8c9d-34b800d069ac tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:53.340192 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:53.353615 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8e54979-ef27-40e8-8c9d-34b800d069ac tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.355135 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8e54979-ef27-40e8-8c9d-34b800d069ac tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.357092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8e54979-ef27-40e8-8c9d-34b800d069ac tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.359628 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8e54979-ef27-40e8-8c9d-34b800d069ac tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.545492 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5f606f79-2a39-4a85-9c68-6b80637e2b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "POST /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.461046 May 25 17:11:53.546874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 205/391] 10.222.0.31 () {62 vars in 1363 bytes} [Wed May 25 17:11:53 2022] POST /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments => generated 188 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:11:53.555984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-2d01e9f6-0bbf-4626-aad2-53862316ed53 req-eb0826b1-5233-427e-a09c-1c57856a6e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99e2d9c-ac45-4a8e-8076-faaf830c29e0", "name": "network-vif-unplugged", "status": "completed", "tag": "fa9d31d9-985b-4772-a564-1cbeee313f84"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:53.566900 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-2d01e9f6-0bbf-4626-aad2-53862316ed53 req-eb0826b1-5233-427e-a09c-1c57856a6e2a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.567658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-2d01e9f6-0bbf-4626-aad2-53862316ed53 req-eb0826b1-5233-427e-a09c-1c57856a6e2a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.581096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.compute.server_external_events [req-2d01e9f6-0bbf-4626-aad2-53862316ed53 req-eb0826b1-5233-427e-a09c-1c57856a6e2a service nova] Unable to find a host for instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0. Dropping event network-vif-unplugged {{(pid=117695) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 17:11:53.582967 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-2d01e9f6-0bbf-4626-aad2-53862316ed53 req-eb0826b1-5233-427e-a09c-1c57856a6e2a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034771 May 25 17:11:53.584084 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 206/392] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 25 17:11:53.621162 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2c880842-da82-4cb6-b531-97a2410d7e31 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:53.622174 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2c880842-da82-4cb6-b531-97a2410d7e31 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:53.625501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:53.630936 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2c880842-da82-4cb6-b531-97a2410d7e31 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.631495 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2c880842-da82-4cb6-b531-97a2410d7e31 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.632320 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2c880842-da82-4cb6-b531-97a2410d7e31 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.632805 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2c880842-da82-4cb6-b531-97a2410d7e31 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.643663 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e8e54979-ef27-40e8-8c9d-34b800d069ac tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:53.651505 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e8e54979-ef27-40e8-8c9d-34b800d069ac tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.319679 May 25 17:11:53.652285 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 187/393] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:53 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:53.690912 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-63b53ca4-c63a-4dbb-b2ef-e49431f32b4f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:53.691578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-63b53ca4-c63a-4dbb-b2ef-e49431f32b4f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:53.697770 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-63b53ca4-c63a-4dbb-b2ef-e49431f32b4f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.698423 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-63b53ca4-c63a-4dbb-b2ef-e49431f32b4f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.699326 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-63b53ca4-c63a-4dbb-b2ef-e49431f32b4f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.699764 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-63b53ca4-c63a-4dbb-b2ef-e49431f32b4f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.780090 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2c880842-da82-4cb6-b531-97a2410d7e31 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:53.787892 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2c880842-da82-4cb6-b531-97a2410d7e31 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.170946 May 25 17:11:53.788464 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 207/394] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:53 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:53.791245 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-63b53ca4-c63a-4dbb-b2ef-e49431f32b4f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "POST /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/action" status: 202 len: 0 microversion: 2.20 time: 0.105671 May 25 17:11:53.795652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 188/395] 10.222.0.31 () {62 vars in 1318 bytes} [Wed May 25 17:11:53 2022] POST /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 25 17:11:53.801301 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-deb4ca49-487a-498d-9b0e-b94c0f31ca11 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:53.802319 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-deb4ca49-487a-498d-9b0e-b94c0f31ca11 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:53.808732 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-deb4ca49-487a-498d-9b0e-b94c0f31ca11 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.809194 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-deb4ca49-487a-498d-9b0e-b94c0f31ca11 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.810106 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-deb4ca49-487a-498d-9b0e-b94c0f31ca11 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.811511 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-deb4ca49-487a-498d-9b0e-b94c0f31ca11 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.965869 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-deb4ca49-487a-498d-9b0e-b94c0f31ca11 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:53.970355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:53.977358 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b89caa5d-cc9a-41e2-a32f-7fee4874d105 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:53.977974 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b89caa5d-cc9a-41e2-a32f-7fee4874d105 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:53.985371 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b89caa5d-cc9a-41e2-a32f-7fee4874d105 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.986076 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b89caa5d-cc9a-41e2-a32f-7fee4874d105 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.987010 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b89caa5d-cc9a-41e2-a32f-7fee4874d105 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:53.987591 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b89caa5d-cc9a-41e2-a32f-7fee4874d105 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:53.989662 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-deb4ca49-487a-498d-9b0e-b94c0f31ca11 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:53.993454 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-deb4ca49-487a-498d-9b0e-b94c0f31ca11 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:53.995347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-deb4ca49-487a-498d-9b0e-b94c0f31ca11 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1749 microversion: 2.20 time: 0.198373 May 25 17:11:53.996098 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 208/396] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:53 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1749 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:54.205408 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b89caa5d-cc9a-41e2-a32f-7fee4874d105 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:54.213481 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b89caa5d-cc9a-41e2-a32f-7fee4874d105 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1708 microversion: 2.1 time: 0.240042 May 25 17:11:54.214049 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 189/397] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:53 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1708 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:54.669621 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1147fb82-fa07-43d4-9a94-be0b1db95147 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:54.670410 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1147fb82-fa07-43d4-9a94-be0b1db95147 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:54.678737 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1147fb82-fa07-43d4-9a94-be0b1db95147 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:54.679489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1147fb82-fa07-43d4-9a94-be0b1db95147 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:54.681609 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1147fb82-fa07-43d4-9a94-be0b1db95147 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:54.682256 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1147fb82-fa07-43d4-9a94-be0b1db95147 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:54.807253 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5c0c46ed-8e57-4924-b2b1-118a9e54e024 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:54.808147 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5c0c46ed-8e57-4924-b2b1-118a9e54e024 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:54.820385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5c0c46ed-8e57-4924-b2b1-118a9e54e024 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:54.821241 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5c0c46ed-8e57-4924-b2b1-118a9e54e024 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:54.823555 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5c0c46ed-8e57-4924-b2b1-118a9e54e024 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:54.825969 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5c0c46ed-8e57-4924-b2b1-118a9e54e024 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:54.834098 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1147fb82-fa07-43d4-9a94-be0b1db95147 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:54.845230 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1147fb82-fa07-43d4-9a94-be0b1db95147 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1366 microversion: 2.1 time: 0.179775 May 25 17:11:54.846092 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 209/398] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:54 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:54.986606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5c0c46ed-8e57-4924-b2b1-118a9e54e024 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:54.994499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5c0c46ed-8e57-4924-b2b1-118a9e54e024 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.192151 May 25 17:11:54.995062 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 190/399] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:54 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:55.015188 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c5baff7b-748f-4965-a16e-1ee933e6e3bc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:55.015797 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c5baff7b-748f-4965-a16e-1ee933e6e3bc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:55.021897 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5baff7b-748f-4965-a16e-1ee933e6e3bc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:55.022375 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5baff7b-748f-4965-a16e-1ee933e6e3bc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:55.023122 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5baff7b-748f-4965-a16e-1ee933e6e3bc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:55.023563 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5baff7b-748f-4965-a16e-1ee933e6e3bc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:55.152569 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c5baff7b-748f-4965-a16e-1ee933e6e3bc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:55.161777 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c5baff7b-748f-4965-a16e-1ee933e6e3bc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:55.163349 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c5baff7b-748f-4965-a16e-1ee933e6e3bc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:55.164921 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c5baff7b-748f-4965-a16e-1ee933e6e3bc tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1749 microversion: 2.20 time: 0.153595 May 25 17:11:55.165481 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 210/400] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:55 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:55.230407 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a1149418-0101-445c-9bbf-e001561ad74a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:55.231823 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a1149418-0101-445c-9bbf-e001561ad74a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:55.242408 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a1149418-0101-445c-9bbf-e001561ad74a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:55.243190 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a1149418-0101-445c-9bbf-e001561ad74a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:55.244363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a1149418-0101-445c-9bbf-e001561ad74a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:55.245606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a1149418-0101-445c-9bbf-e001561ad74a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:55.396804 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a1149418-0101-445c-9bbf-e001561ad74a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:55.412144 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a1149418-0101-445c-9bbf-e001561ad74a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1708 microversion: 2.1 time: 0.185433 May 25 17:11:55.413414 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 191/401] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:55 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1708 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:55.608150 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-ca5c816b-6339-4240-ae77-a7d92ad8a9c9 req-74493669-dd14-4a3b-ac0e-d4da29ec003e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eac90cb-0606-4589-b405-8d607816944a", "name": "network-vif-plugged", "status": "completed", "tag": "15213f99-cfc9-459a-abff-c83378d5b919"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:55.616148 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-ca5c816b-6339-4240-ae77-a7d92ad8a9c9 req-74493669-dd14-4a3b-ac0e-d4da29ec003e service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:55.616592 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-ca5c816b-6339-4240-ae77-a7d92ad8a9c9 req-74493669-dd14-4a3b-ac0e-d4da29ec003e service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:55.628392 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-ca5c816b-6339-4240-ae77-a7d92ad8a9c9 req-74493669-dd14-4a3b-ac0e-d4da29ec003e service nova] Creating event network-vif-plugged:15213f99-cfc9-459a-abff-c83378d5b919 for instance 7eac90cb-0606-4589-b405-8d607816944a on hv-cinder-84330 May 25 17:11:55.633279 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-ca5c816b-6339-4240-ae77-a7d92ad8a9c9 req-74493669-dd14-4a3b-ac0e-d4da29ec003e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029389 May 25 17:11:55.633843 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 211/402] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:11:55.862245 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2c5c0c69-cc97-4683-8a04-12a6631777e4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:55.862967 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2c5c0c69-cc97-4683-8a04-12a6631777e4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:55.869695 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c5c0c69-cc97-4683-8a04-12a6631777e4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:55.870163 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c5c0c69-cc97-4683-8a04-12a6631777e4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:55.870926 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c5c0c69-cc97-4683-8a04-12a6631777e4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:55.871364 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c5c0c69-cc97-4683-8a04-12a6631777e4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:56.001397 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2c5c0c69-cc97-4683-8a04-12a6631777e4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:56.009211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2c5c0c69-cc97-4683-8a04-12a6631777e4 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1555 microversion: 2.1 time: 0.151301 May 25 17:11:56.009782 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 192/403] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:55 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:56.012537 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b151c69f-474b-43f3-8ef6-85265f782a8a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:56.013298 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b151c69f-474b-43f3-8ef6-85265f782a8a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:56.019591 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b151c69f-474b-43f3-8ef6-85265f782a8a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:56.020114 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b151c69f-474b-43f3-8ef6-85265f782a8a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:56.020857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b151c69f-474b-43f3-8ef6-85265f782a8a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:56.021327 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b151c69f-474b-43f3-8ef6-85265f782a8a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:56.025557 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-67fd3954-5c7e-4db6-9b9f-8337a74b2d9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:56.026073 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-67fd3954-5c7e-4db6-9b9f-8337a74b2d9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:56.032082 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-67fd3954-5c7e-4db6-9b9f-8337a74b2d9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:56.032530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-67fd3954-5c7e-4db6-9b9f-8337a74b2d9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:56.033316 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-67fd3954-5c7e-4db6-9b9f-8337a74b2d9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:56.033748 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-67fd3954-5c7e-4db6-9b9f-8337a74b2d9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:56.111299 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-67fd3954-5c7e-4db6-9b9f-8337a74b2d9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089386 May 25 17:11:56.111901 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 193/404] 10.222.0.31 () {58 vars in 1274 bytes} [Wed May 25 17:11:56 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:11:56.167245 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b151c69f-474b-43f3-8ef6-85265f782a8a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:56.187777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1a4adafd-30bd-4ab6-bf6d-99697ea2e089 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:56.188933 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1a4adafd-30bd-4ab6-bf6d-99697ea2e089 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:56.193036 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b151c69f-474b-43f3-8ef6-85265f782a8a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.184742 May 25 17:11:56.193669 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 212/405] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:56 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:56.198282 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a4adafd-30bd-4ab6-bf6d-99697ea2e089 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:56.199184 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a4adafd-30bd-4ab6-bf6d-99697ea2e089 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:56.200223 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a4adafd-30bd-4ab6-bf6d-99697ea2e089 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:56.200922 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a4adafd-30bd-4ab6-bf6d-99697ea2e089 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:56.430228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-06766f01-24c1-4228-8ae9-e97229d5f492 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:56.430840 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-06766f01-24c1-4228-8ae9-e97229d5f492 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:56.445622 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06766f01-24c1-4228-8ae9-e97229d5f492 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:56.446080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06766f01-24c1-4228-8ae9-e97229d5f492 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:56.447057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06766f01-24c1-4228-8ae9-e97229d5f492 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:56.447490 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06766f01-24c1-4228-8ae9-e97229d5f492 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:56.537187 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1a4adafd-30bd-4ab6-bf6d-99697ea2e089 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:56.546893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1a4adafd-30bd-4ab6-bf6d-99697ea2e089 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:56.548514 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1a4adafd-30bd-4ab6-bf6d-99697ea2e089 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:56.549805 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1a4adafd-30bd-4ab6-bf6d-99697ea2e089 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1751 microversion: 2.20 time: 0.370331 May 25 17:11:56.550665 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 194/406] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:56 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1751 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:56.594289 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-06766f01-24c1-4228-8ae9-e97229d5f492 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:56.602840 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-06766f01-24c1-4228-8ae9-e97229d5f492 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1712 microversion: 2.1 time: 0.176415 May 25 17:11:56.603412 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 213/407] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:56 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1712 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:57.209077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-15e9748b-e166-465d-912e-92ad19ba6feb tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:57.209746 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-15e9748b-e166-465d-912e-92ad19ba6feb tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:57.216367 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15e9748b-e166-465d-912e-92ad19ba6feb tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:57.216854 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15e9748b-e166-465d-912e-92ad19ba6feb tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:57.217616 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15e9748b-e166-465d-912e-92ad19ba6feb tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:57.218051 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15e9748b-e166-465d-912e-92ad19ba6feb tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:57.389352 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-10b6cce2-88e6-44ca-aaa4-94fdf25b9679 req-8bab1e80-fbb4-4270-a513-0cd95845f103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "145de36f-e49b-4444-85c5-4a207d31619b", "tag": "59d8b30c-3e18-47c8-ad7a-a6090706a8e6"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:57.400258 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-10b6cce2-88e6-44ca-aaa4-94fdf25b9679 req-8bab1e80-fbb4-4270-a513-0cd95845f103 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:57.400692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-10b6cce2-88e6-44ca-aaa4-94fdf25b9679 req-8bab1e80-fbb4-4270-a513-0cd95845f103 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:57.414179 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-15e9748b-e166-465d-912e-92ad19ba6feb tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:57.414327 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-10b6cce2-88e6-44ca-aaa4-94fdf25b9679 req-8bab1e80-fbb4-4270-a513-0cd95845f103 service nova] Creating event network-changed:59d8b30c-3e18-47c8-ad7a-a6090706a8e6 for instance 145de36f-e49b-4444-85c5-4a207d31619b on hv-cinder-84330 May 25 17:11:57.419176 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-10b6cce2-88e6-44ca-aaa4-94fdf25b9679 req-8bab1e80-fbb4-4270-a513-0cd95845f103 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034329 May 25 17:11:57.419940 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 214/408] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:11:57.425346 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-15e9748b-e166-465d-912e-92ad19ba6feb tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.220054 May 25 17:11:57.426405 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 195/409] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:57 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:57.569833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-be32c5c3-e910-42dc-a520-29814005e3fa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:57.570525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-be32c5c3-e910-42dc-a520-29814005e3fa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:57.576974 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be32c5c3-e910-42dc-a520-29814005e3fa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:57.577427 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be32c5c3-e910-42dc-a520-29814005e3fa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:57.578197 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be32c5c3-e910-42dc-a520-29814005e3fa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:57.578641 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be32c5c3-e910-42dc-a520-29814005e3fa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:57.721678 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-be32c5c3-e910-42dc-a520-29814005e3fa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:57.730637 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-be32c5c3-e910-42dc-a520-29814005e3fa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:57.732182 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-be32c5c3-e910-42dc-a520-29814005e3fa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:57.734788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-be32c5c3-e910-42dc-a520-29814005e3fa tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.169201 May 25 17:11:57.745105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 215/410] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:57 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:11:58.377634 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2053770284", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1368124714", "security_groups": [{"name": "tempest-secgroup-smoke-1261209830"}], "networks": [{"uuid": "400e769d-9a66-45af-badf-741858a97960"}], "block_device_mapping_v2": [{"uuid": "b47d3d2d-bea5-46dd-a9ab-171d9486b304", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:11:58.443169 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-da3c5f95-061e-4f3c-9ab7-54a7356ea526 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:58.443785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-da3c5f95-061e-4f3c-9ab7-54a7356ea526 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:58.451576 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-da3c5f95-061e-4f3c-9ab7-54a7356ea526 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:58.452227 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-da3c5f95-061e-4f3c-9ab7-54a7356ea526 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:58.453053 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-da3c5f95-061e-4f3c-9ab7-54a7356ea526 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:58.453503 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-da3c5f95-061e-4f3c-9ab7-54a7356ea526 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:58.512524 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] validate_networks() for [('400e769d-9a66-45af-badf-741858a97960', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:11:58.594930 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-da3c5f95-061e-4f3c-9ab7-54a7356ea526 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:58.603720 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-da3c5f95-061e-4f3c-9ab7-54a7356ea526 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1319 microversion: 2.1 time: 0.164310 May 25 17:11:58.604519 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 216/411] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:58 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:58.754527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8a42c581-5c3d-4456-ad74-93f5a12ab536 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:58.755140 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8a42c581-5c3d-4456-ad74-93f5a12ab536 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:58.761109 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8a42c581-5c3d-4456-ad74-93f5a12ab536 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:58.761562 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8a42c581-5c3d-4456-ad74-93f5a12ab536 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:58.762328 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8a42c581-5c3d-4456-ad74-93f5a12ab536 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:58.762766 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8a42c581-5c3d-4456-ad74-93f5a12ab536 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:58.897175 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8a42c581-5c3d-4456-ad74-93f5a12ab536 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:58.905843 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8a42c581-5c3d-4456-ad74-93f5a12ab536 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:58.907360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8a42c581-5c3d-4456-ad74-93f5a12ab536 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:58.908531 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8a42c581-5c3d-4456-ad74-93f5a12ab536 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.157924 May 25 17:11:58.909134 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 217/412] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:58 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:11:59.314834 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:11:59.315283 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:11:59.316300 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:11:59.316751 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:11:59.317172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:11:59.326026 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:59.326991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:59.327799 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:59.328234 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:59.345989 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Getting quotas for project 1d67075f4eaf4908acb0c2763153b81c. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:11:59.350178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Getting quotas for user 96f7eb5295ad40df898f93f1505a7df7 and project 1d67075f4eaf4908acb0c2763153b81c. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:11:59.418487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:11:59.421671 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b47d3d2d-bea5-46dd-a9ab-171d9486b304',volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:11:59.555168 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-adb4dbde-835e-4b28-bd67-4c0550ffa6de tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.182146 May 25 17:11:59.561024 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 196/413] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:11:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:11:59.566107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e8e8f6f8-227d-4125-969f-0352ba1860d3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:59.566717 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e8e8f6f8-227d-4125-969f-0352ba1860d3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:59.621176 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cb92caba-679a-4eed-99c7-0e71c49fcfb7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:59.621842 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cb92caba-679a-4eed-99c7-0e71c49fcfb7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:59.626581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e8e8f6f8-227d-4125-969f-0352ba1860d3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:59.633173 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e8e8f6f8-227d-4125-969f-0352ba1860d3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1089 microversion: 2.1 time: 0.071165 May 25 17:11:59.633992 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 218/414] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:59 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:11:59.639407 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb92caba-679a-4eed-99c7-0e71c49fcfb7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:59.639829 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb92caba-679a-4eed-99c7-0e71c49fcfb7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:59.640540 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb92caba-679a-4eed-99c7-0e71c49fcfb7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:59.641004 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb92caba-679a-4eed-99c7-0e71c49fcfb7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:59.646303 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:59.803311 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cb92caba-679a-4eed-99c7-0e71c49fcfb7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:11:59.811882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cb92caba-679a-4eed-99c7-0e71c49fcfb7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1508 microversion: 2.1 time: 0.194487 May 25 17:11:59.812460 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 197/415] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:11:59 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:11:59.927230 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-85d25dc0-61c1-49d8-be1f-468c326900fb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:11:59.927834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-85d25dc0-61c1-49d8-be1f-468c326900fb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:11:59.933797 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85d25dc0-61c1-49d8-be1f-468c326900fb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:59.934456 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85d25dc0-61c1-49d8-be1f-468c326900fb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:11:59.935470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85d25dc0-61c1-49d8-be1f-468c326900fb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:11:59.936314 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85d25dc0-61c1-49d8-be1f-468c326900fb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:00.150828 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-85d25dc0-61c1-49d8-be1f-468c326900fb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:00.164322 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-85d25dc0-61c1-49d8-be1f-468c326900fb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:00.166100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-85d25dc0-61c1-49d8-be1f-468c326900fb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:00.168011 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-85d25dc0-61c1-49d8-be1f-468c326900fb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.244684 May 25 17:12:00.181608 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 219/416] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:11:59 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:00.650531 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a5027008-1953-46ba-ae29-d929834bd362 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:00.651364 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a5027008-1953-46ba-ae29-d929834bd362 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:00.660564 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a5027008-1953-46ba-ae29-d929834bd362 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:00.661360 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a5027008-1953-46ba-ae29-d929834bd362 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:00.662409 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a5027008-1953-46ba-ae29-d929834bd362 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:00.662856 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a5027008-1953-46ba-ae29-d929834bd362 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:00.762520 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a5027008-1953-46ba-ae29-d929834bd362 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:00.771055 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a5027008-1953-46ba-ae29-d929834bd362 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.124088 May 25 17:12:00.771640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 198/417] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:00 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:12:01.188311 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-69ac3364-05d2-4e5a-803b-fc67757aca45 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:01.188861 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-69ac3364-05d2-4e5a-803b-fc67757aca45 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:01.195411 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-69ac3364-05d2-4e5a-803b-fc67757aca45 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:01.195863 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-69ac3364-05d2-4e5a-803b-fc67757aca45 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:01.196622 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-69ac3364-05d2-4e5a-803b-fc67757aca45 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:01.197086 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-69ac3364-05d2-4e5a-803b-fc67757aca45 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:01.350737 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-69ac3364-05d2-4e5a-803b-fc67757aca45 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:01.359620 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-69ac3364-05d2-4e5a-803b-fc67757aca45 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:01.361169 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-69ac3364-05d2-4e5a-803b-fc67757aca45 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:01.362333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-69ac3364-05d2-4e5a-803b-fc67757aca45 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.178845 May 25 17:12:01.362900 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 220/418] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:01 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:01.788188 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8d806a76-4d43-4ea8-833f-371a85ce1005 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:01.788745 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8d806a76-4d43-4ea8-833f-371a85ce1005 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:01.795518 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8d806a76-4d43-4ea8-833f-371a85ce1005 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:01.795970 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8d806a76-4d43-4ea8-833f-371a85ce1005 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:01.796772 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8d806a76-4d43-4ea8-833f-371a85ce1005 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:01.797215 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8d806a76-4d43-4ea8-833f-371a85ce1005 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:01.883364 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8d806a76-4d43-4ea8-833f-371a85ce1005 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:01.892993 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8d806a76-4d43-4ea8-833f-371a85ce1005 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.108779 May 25 17:12:01.893586 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 199/419] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:01 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:02.380630 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-39e5de44-95a1-43c5-bbde-9296f365145f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:02.381273 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-39e5de44-95a1-43c5-bbde-9296f365145f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:02.387914 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-39e5de44-95a1-43c5-bbde-9296f365145f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:02.388433 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-39e5de44-95a1-43c5-bbde-9296f365145f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:02.389244 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-39e5de44-95a1-43c5-bbde-9296f365145f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:02.389684 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-39e5de44-95a1-43c5-bbde-9296f365145f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:02.526985 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-39e5de44-95a1-43c5-bbde-9296f365145f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:02.536709 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-39e5de44-95a1-43c5-bbde-9296f365145f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:02.538285 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-39e5de44-95a1-43c5-bbde-9296f365145f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:02.539684 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-39e5de44-95a1-43c5-bbde-9296f365145f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.163020 May 25 17:12:02.540399 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 221/420] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:02 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:02.911297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5ed30b6b-828f-4da7-843f-7411b6b71747 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:02.912089 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5ed30b6b-828f-4da7-843f-7411b6b71747 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:02.919679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ed30b6b-828f-4da7-843f-7411b6b71747 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:02.920137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ed30b6b-828f-4da7-843f-7411b6b71747 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:02.920973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ed30b6b-828f-4da7-843f-7411b6b71747 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:02.921413 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ed30b6b-828f-4da7-843f-7411b6b71747 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:02.985237 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ed30b6b-828f-4da7-843f-7411b6b71747 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:02.993047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5ed30b6b-828f-4da7-843f-7411b6b71747 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.086140 May 25 17:12:02.994035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 200/421] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:02 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:03.559070 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2515109c-b926-42d1-a2f6-d911e2b56bb4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:03.559688 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2515109c-b926-42d1-a2f6-d911e2b56bb4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:03.567452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2515109c-b926-42d1-a2f6-d911e2b56bb4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:03.567900 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2515109c-b926-42d1-a2f6-d911e2b56bb4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:03.568770 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2515109c-b926-42d1-a2f6-d911e2b56bb4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:03.569361 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2515109c-b926-42d1-a2f6-d911e2b56bb4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:03.709060 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2515109c-b926-42d1-a2f6-d911e2b56bb4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:03.717697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2515109c-b926-42d1-a2f6-d911e2b56bb4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:03.719201 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2515109c-b926-42d1-a2f6-d911e2b56bb4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:03.720366 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2515109c-b926-42d1-a2f6-d911e2b56bb4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.165417 May 25 17:12:03.721005 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 222/422] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:03 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:04.010781 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4c15e47b-f7c2-4060-a0ba-60203fea15af tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:04.011300 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4c15e47b-f7c2-4060-a0ba-60203fea15af tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:04.018061 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4c15e47b-f7c2-4060-a0ba-60203fea15af tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:04.018509 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4c15e47b-f7c2-4060-a0ba-60203fea15af tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:04.019273 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4c15e47b-f7c2-4060-a0ba-60203fea15af tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:04.019709 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4c15e47b-f7c2-4060-a0ba-60203fea15af tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:04.080080 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4c15e47b-f7c2-4060-a0ba-60203fea15af tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:04.087499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4c15e47b-f7c2-4060-a0ba-60203fea15af tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.080786 May 25 17:12:04.088059 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 201/423] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:04 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:04.738586 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-cdaa5333-a385-4a4c-a24f-e0fea8c8472e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:04.739205 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-cdaa5333-a385-4a4c-a24f-e0fea8c8472e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:04.745783 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cdaa5333-a385-4a4c-a24f-e0fea8c8472e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:04.746245 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cdaa5333-a385-4a4c-a24f-e0fea8c8472e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:04.747024 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cdaa5333-a385-4a4c-a24f-e0fea8c8472e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:04.747465 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cdaa5333-a385-4a4c-a24f-e0fea8c8472e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:04.914695 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-cdaa5333-a385-4a4c-a24f-e0fea8c8472e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:04.923557 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-cdaa5333-a385-4a4c-a24f-e0fea8c8472e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:04.925090 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-cdaa5333-a385-4a4c-a24f-e0fea8c8472e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:04.926242 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-cdaa5333-a385-4a4c-a24f-e0fea8c8472e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.191526 May 25 17:12:04.926810 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 223/424] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:04 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:05.105185 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-de29b8ca-61b7-4430-af28-1531bad48e42 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:05.105833 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-de29b8ca-61b7-4430-af28-1531bad48e42 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:05.112983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de29b8ca-61b7-4430-af28-1531bad48e42 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:05.113428 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de29b8ca-61b7-4430-af28-1531bad48e42 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:05.114195 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de29b8ca-61b7-4430-af28-1531bad48e42 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:05.114626 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de29b8ca-61b7-4430-af28-1531bad48e42 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:05.184319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-de29b8ca-61b7-4430-af28-1531bad48e42 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:05.195486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-de29b8ca-61b7-4430-af28-1531bad48e42 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.094173 May 25 17:12:05.196067 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 202/425] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:05 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:05.945379 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6ee552e9-1336-4188-9bf4-0f0cda2c486b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:05.945982 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6ee552e9-1336-4188-9bf4-0f0cda2c486b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:05.952508 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6ee552e9-1336-4188-9bf4-0f0cda2c486b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:05.952990 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6ee552e9-1336-4188-9bf4-0f0cda2c486b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:05.953750 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6ee552e9-1336-4188-9bf4-0f0cda2c486b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:05.954186 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6ee552e9-1336-4188-9bf4-0f0cda2c486b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:06.093122 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6ee552e9-1336-4188-9bf4-0f0cda2c486b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:06.122339 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6ee552e9-1336-4188-9bf4-0f0cda2c486b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:06.124323 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6ee552e9-1336-4188-9bf4-0f0cda2c486b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:06.125677 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6ee552e9-1336-4188-9bf4-0f0cda2c486b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.184381 May 25 17:12:06.126708 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 224/426] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:05 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:06.218107 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a75b653a-5340-4480-b54a-2ef2fa78aa51 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:06.219571 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a75b653a-5340-4480-b54a-2ef2fa78aa51 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:06.230814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a75b653a-5340-4480-b54a-2ef2fa78aa51 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:06.231266 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a75b653a-5340-4480-b54a-2ef2fa78aa51 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:06.232856 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a75b653a-5340-4480-b54a-2ef2fa78aa51 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:06.233331 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a75b653a-5340-4480-b54a-2ef2fa78aa51 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:06.305737 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a75b653a-5340-4480-b54a-2ef2fa78aa51 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:06.313409 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a75b653a-5340-4480-b54a-2ef2fa78aa51 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.102290 May 25 17:12:06.323717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 203/427] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:06 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:07.144993 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0535aa6c-b480-444a-8236-f80fa9744cfb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:07.145653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0535aa6c-b480-444a-8236-f80fa9744cfb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:07.151774 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0535aa6c-b480-444a-8236-f80fa9744cfb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:07.152225 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0535aa6c-b480-444a-8236-f80fa9744cfb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:07.153019 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0535aa6c-b480-444a-8236-f80fa9744cfb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:07.153545 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0535aa6c-b480-444a-8236-f80fa9744cfb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:07.283339 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0535aa6c-b480-444a-8236-f80fa9744cfb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:07.291733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0535aa6c-b480-444a-8236-f80fa9744cfb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:07.293281 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0535aa6c-b480-444a-8236-f80fa9744cfb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:07.294929 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0535aa6c-b480-444a-8236-f80fa9744cfb tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.153483 May 25 17:12:07.295560 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 225/428] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:07 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:07.330385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-787b423c-ae88-4bf8-a0e5-b3905a6f048c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:07.331024 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-787b423c-ae88-4bf8-a0e5-b3905a6f048c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:07.337621 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-787b423c-ae88-4bf8-a0e5-b3905a6f048c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:07.338074 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-787b423c-ae88-4bf8-a0e5-b3905a6f048c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:07.338835 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-787b423c-ae88-4bf8-a0e5-b3905a6f048c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:07.339274 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-787b423c-ae88-4bf8-a0e5-b3905a6f048c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:07.420568 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-787b423c-ae88-4bf8-a0e5-b3905a6f048c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:07.429415 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-787b423c-ae88-4bf8-a0e5-b3905a6f048c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.102864 May 25 17:12:07.430190 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 204/429] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:07 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:08.313528 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-32dde4dc-3cd9-4d78-9f58-7414887928bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:08.314200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-32dde4dc-3cd9-4d78-9f58-7414887928bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:08.320611 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-32dde4dc-3cd9-4d78-9f58-7414887928bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:08.321095 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-32dde4dc-3cd9-4d78-9f58-7414887928bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:08.321870 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-32dde4dc-3cd9-4d78-9f58-7414887928bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:08.322308 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-32dde4dc-3cd9-4d78-9f58-7414887928bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:08.447425 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-02d0f6c0-89c8-4f88-b6bd-80dfd632b9ea tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:08.448880 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-02d0f6c0-89c8-4f88-b6bd-80dfd632b9ea tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:08.456840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-02d0f6c0-89c8-4f88-b6bd-80dfd632b9ea tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:08.457663 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-02d0f6c0-89c8-4f88-b6bd-80dfd632b9ea tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:08.458680 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-02d0f6c0-89c8-4f88-b6bd-80dfd632b9ea tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:08.459336 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-02d0f6c0-89c8-4f88-b6bd-80dfd632b9ea tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:08.484131 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-32dde4dc-3cd9-4d78-9f58-7414887928bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:08.494626 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-32dde4dc-3cd9-4d78-9f58-7414887928bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:08.496517 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-32dde4dc-3cd9-4d78-9f58-7414887928bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:08.499035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-32dde4dc-3cd9-4d78-9f58-7414887928bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.189343 May 25 17:12:08.499954 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 226/430] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:08 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:08.529761 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-02d0f6c0-89c8-4f88-b6bd-80dfd632b9ea tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:08.537956 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-02d0f6c0-89c8-4f88-b6bd-80dfd632b9ea tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.094287 May 25 17:12:08.538726 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 205/431] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:08 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:12:09.518057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9bbb9bfe-88cd-400d-9426-da3c2c3ca319 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:09.518704 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-9bbb9bfe-88cd-400d-9426-da3c2c3ca319 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:09.525175 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9bbb9bfe-88cd-400d-9426-da3c2c3ca319 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:09.525633 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9bbb9bfe-88cd-400d-9426-da3c2c3ca319 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:09.526400 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9bbb9bfe-88cd-400d-9426-da3c2c3ca319 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:09.526840 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9bbb9bfe-88cd-400d-9426-da3c2c3ca319 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:09.555718 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-42d2e696-4a94-4f47-b1ec-c2c747ce8941 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:09.556459 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-42d2e696-4a94-4f47-b1ec-c2c747ce8941 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:09.562047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:09.563386 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:09.566509 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-42d2e696-4a94-4f47-b1ec-c2c747ce8941 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:09.566961 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-42d2e696-4a94-4f47-b1ec-c2c747ce8941 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:09.567734 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-42d2e696-4a94-4f47-b1ec-c2c747ce8941 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:09.568165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-42d2e696-4a94-4f47-b1ec-c2c747ce8941 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:09.632409 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:09.636981 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-42d2e696-4a94-4f47-b1ec-c2c747ce8941 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:09.645271 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-42d2e696-4a94-4f47-b1ec-c2c747ce8941 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.093504 May 25 17:12:09.655089 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 206/432] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:09 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:12:09.696501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9bbb9bfe-88cd-400d-9426-da3c2c3ca319 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:09.700086 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=100 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:09.707132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9bbb9bfe-88cd-400d-9426-da3c2c3ca319 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:09.708649 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9bbb9bfe-88cd-400d-9426-da3c2c3ca319 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:09.709868 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9bbb9bfe-88cd-400d-9426-da3c2c3ca319 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.196571 May 25 17:12:09.710422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 227/433] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:09 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:10.662208 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2f8a4798-46c6-4642-87e9-99de92a1d7da tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:10.662895 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2f8a4798-46c6-4642-87e9-99de92a1d7da tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:10.669643 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f8a4798-46c6-4642-87e9-99de92a1d7da tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:10.670309 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f8a4798-46c6-4642-87e9-99de92a1d7da tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:10.671082 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f8a4798-46c6-4642-87e9-99de92a1d7da tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:10.671554 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f8a4798-46c6-4642-87e9-99de92a1d7da tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:10.729821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4df3d927-e305-4a13-aecb-bdb09c7ff5fd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:10.730547 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4df3d927-e305-4a13-aecb-bdb09c7ff5fd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:10.736309 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2f8a4798-46c6-4642-87e9-99de92a1d7da tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:10.741294 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4df3d927-e305-4a13-aecb-bdb09c7ff5fd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:10.741840 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4df3d927-e305-4a13-aecb-bdb09c7ff5fd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:10.743026 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4df3d927-e305-4a13-aecb-bdb09c7ff5fd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:10.743476 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4df3d927-e305-4a13-aecb-bdb09c7ff5fd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:10.744388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2f8a4798-46c6-4642-87e9-99de92a1d7da tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.086046 May 25 17:12:10.754612 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 207/434] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:10 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:10.894724 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4df3d927-e305-4a13-aecb-bdb09c7ff5fd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:10.904590 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4df3d927-e305-4a13-aecb-bdb09c7ff5fd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:10.905823 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4df3d927-e305-4a13-aecb-bdb09c7ff5fd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:10.907023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4df3d927-e305-4a13-aecb-bdb09c7ff5fd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.181585 May 25 17:12:10.919844 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 228/435] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:10 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:12:11.761485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f71b9acf-e47c-4e64-afa1-e7467b23f454 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:11.762097 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f71b9acf-e47c-4e64-afa1-e7467b23f454 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:11.769565 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f71b9acf-e47c-4e64-afa1-e7467b23f454 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:11.770020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f71b9acf-e47c-4e64-afa1-e7467b23f454 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:11.770797 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f71b9acf-e47c-4e64-afa1-e7467b23f454 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:11.771241 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f71b9acf-e47c-4e64-afa1-e7467b23f454 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:11.836299 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f71b9acf-e47c-4e64-afa1-e7467b23f454 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:11.844955 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f71b9acf-e47c-4e64-afa1-e7467b23f454 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.087895 May 25 17:12:11.845550 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 208/436] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:11 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:11.924990 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f28dcfd6-ca43-4900-97c1-d0ebe305c970 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:11.925589 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f28dcfd6-ca43-4900-97c1-d0ebe305c970 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:11.932260 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f28dcfd6-ca43-4900-97c1-d0ebe305c970 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:11.932641 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f28dcfd6-ca43-4900-97c1-d0ebe305c970 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:11.933426 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f28dcfd6-ca43-4900-97c1-d0ebe305c970 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:11.933856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f28dcfd6-ca43-4900-97c1-d0ebe305c970 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:12.068479 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f28dcfd6-ca43-4900-97c1-d0ebe305c970 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:12.077326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f28dcfd6-ca43-4900-97c1-d0ebe305c970 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:12.078899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f28dcfd6-ca43-4900-97c1-d0ebe305c970 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:12.080131 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f28dcfd6-ca43-4900-97c1-d0ebe305c970 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.159162 May 25 17:12:12.080864 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 229/437] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:11 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:12.863250 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-19137a5f-7933-4a1c-ad51-887fadbaef63 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:12.863856 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-19137a5f-7933-4a1c-ad51-887fadbaef63 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:12.870291 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19137a5f-7933-4a1c-ad51-887fadbaef63 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:12.870734 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19137a5f-7933-4a1c-ad51-887fadbaef63 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:12.871633 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19137a5f-7933-4a1c-ad51-887fadbaef63 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:12.872097 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19137a5f-7933-4a1c-ad51-887fadbaef63 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:12.933447 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-19137a5f-7933-4a1c-ad51-887fadbaef63 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:12.941297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-19137a5f-7933-4a1c-ad51-887fadbaef63 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1139 microversion: 2.1 time: 0.081860 May 25 17:12:12.941863 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 209/438] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:12 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:13.098158 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-89d97f2b-9132-4e1d-b6fd-6dd6785abb2e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:13.098767 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-89d97f2b-9132-4e1d-b6fd-6dd6785abb2e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:13.105463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89d97f2b-9132-4e1d-b6fd-6dd6785abb2e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:13.105930 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89d97f2b-9132-4e1d-b6fd-6dd6785abb2e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:13.106723 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89d97f2b-9132-4e1d-b6fd-6dd6785abb2e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:13.108192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-89d97f2b-9132-4e1d-b6fd-6dd6785abb2e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:13.242379 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-89d97f2b-9132-4e1d-b6fd-6dd6785abb2e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:13.253786 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-89d97f2b-9132-4e1d-b6fd-6dd6785abb2e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:13.255890 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-89d97f2b-9132-4e1d-b6fd-6dd6785abb2e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:13.257561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-89d97f2b-9132-4e1d-b6fd-6dd6785abb2e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.163306 May 25 17:12:13.258360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 230/439] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:13 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:13.957784 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a6ca0ec1-22d6-4d01-b3af-77b0b57d130b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:13.958307 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a6ca0ec1-22d6-4d01-b3af-77b0b57d130b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:13.964791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6ca0ec1-22d6-4d01-b3af-77b0b57d130b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:13.965244 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6ca0ec1-22d6-4d01-b3af-77b0b57d130b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:13.966755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6ca0ec1-22d6-4d01-b3af-77b0b57d130b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:13.967207 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6ca0ec1-22d6-4d01-b3af-77b0b57d130b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:14.033698 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a6ca0ec1-22d6-4d01-b3af-77b0b57d130b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:14.041143 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a6ca0ec1-22d6-4d01-b3af-77b0b57d130b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1187 microversion: 2.1 time: 0.087305 May 25 17:12:14.041706 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 210/440] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:13 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:14.276337 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8dd4b9d9-b2b6-4583-81cf-156174771b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:14.278180 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8dd4b9d9-b2b6-4583-81cf-156174771b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:14.285600 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8dd4b9d9-b2b6-4583-81cf-156174771b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:14.286053 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8dd4b9d9-b2b6-4583-81cf-156174771b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:14.286851 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8dd4b9d9-b2b6-4583-81cf-156174771b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:14.287289 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8dd4b9d9-b2b6-4583-81cf-156174771b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:14.421295 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8dd4b9d9-b2b6-4583-81cf-156174771b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:14.429625 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8dd4b9d9-b2b6-4583-81cf-156174771b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:14.431130 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8dd4b9d9-b2b6-4583-81cf-156174771b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:14.432277 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8dd4b9d9-b2b6-4583-81cf-156174771b79 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.159953 May 25 17:12:14.432875 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 231/441] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:14 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:15.058468 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2d49c69f-8ea0-4f24-99ba-b0da9aec937d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:15.059060 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2d49c69f-8ea0-4f24-99ba-b0da9aec937d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:15.066448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d49c69f-8ea0-4f24-99ba-b0da9aec937d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:15.066891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d49c69f-8ea0-4f24-99ba-b0da9aec937d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:15.067650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d49c69f-8ea0-4f24-99ba-b0da9aec937d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:15.068081 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d49c69f-8ea0-4f24-99ba-b0da9aec937d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:15.136184 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2d49c69f-8ea0-4f24-99ba-b0da9aec937d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:15.144468 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2d49c69f-8ea0-4f24-99ba-b0da9aec937d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1205 microversion: 2.1 time: 0.089951 May 25 17:12:15.145088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 211/442] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:15 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1205 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:15.452183 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0b9aad65-630e-476e-aea6-c75abafe37b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:15.453550 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0b9aad65-630e-476e-aea6-c75abafe37b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:15.462569 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b9aad65-630e-476e-aea6-c75abafe37b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:15.463256 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b9aad65-630e-476e-aea6-c75abafe37b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:15.464032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b9aad65-630e-476e-aea6-c75abafe37b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:15.464472 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b9aad65-630e-476e-aea6-c75abafe37b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:15.613775 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0b9aad65-630e-476e-aea6-c75abafe37b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:15.622368 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0b9aad65-630e-476e-aea6-c75abafe37b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:15.623889 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0b9aad65-630e-476e-aea6-c75abafe37b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:15.625212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0b9aad65-630e-476e-aea6-c75abafe37b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.178175 May 25 17:12:15.625771 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 232/443] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:15 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:16.025832 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-6c1b5bb4-87c8-4876-a7aa-025d8e44f773 req-edd0e9f4-bb7c-4662-b97b-52453731b428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b7231c-3070-4cb3-b6a2-732af750f6f4", "tag": "fc321a82-a17f-45cd-ae89-dea85055e57c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:12:16.034563 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6c1b5bb4-87c8-4876-a7aa-025d8e44f773 req-edd0e9f4-bb7c-4662-b97b-52453731b428 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:16.035147 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6c1b5bb4-87c8-4876-a7aa-025d8e44f773 req-edd0e9f4-bb7c-4662-b97b-52453731b428 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:16.048342 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-6c1b5bb4-87c8-4876-a7aa-025d8e44f773 req-edd0e9f4-bb7c-4662-b97b-52453731b428 service nova] Creating event network-changed:fc321a82-a17f-45cd-ae89-dea85055e57c for instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 on hv-cinder-84330 May 25 17:12:16.061647 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-6c1b5bb4-87c8-4876-a7aa-025d8e44f773 req-edd0e9f4-bb7c-4662-b97b-52453731b428 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039704 May 25 17:12:16.062914 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 212/444] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:12:16.163263 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c3e238d4-8f08-49a5-a061-e50d6073f9c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:16.164236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c3e238d4-8f08-49a5-a061-e50d6073f9c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:16.172593 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c3e238d4-8f08-49a5-a061-e50d6073f9c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:16.173092 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c3e238d4-8f08-49a5-a061-e50d6073f9c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:16.173862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c3e238d4-8f08-49a5-a061-e50d6073f9c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:16.174296 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c3e238d4-8f08-49a5-a061-e50d6073f9c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:16.322809 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c3e238d4-8f08-49a5-a061-e50d6073f9c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:16.334321 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c3e238d4-8f08-49a5-a061-e50d6073f9c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.175848 May 25 17:12:16.337835 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 233/445] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:16 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:16.644724 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-83418059-3052-427d-b30c-acf5b3449871 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:16.645461 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-83418059-3052-427d-b30c-acf5b3449871 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:16.651624 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83418059-3052-427d-b30c-acf5b3449871 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:16.652102 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83418059-3052-427d-b30c-acf5b3449871 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:16.652978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83418059-3052-427d-b30c-acf5b3449871 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:16.653463 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83418059-3052-427d-b30c-acf5b3449871 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:16.805427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-83418059-3052-427d-b30c-acf5b3449871 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:16.814183 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-83418059-3052-427d-b30c-acf5b3449871 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:16.815694 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-83418059-3052-427d-b30c-acf5b3449871 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:16.816893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-83418059-3052-427d-b30c-acf5b3449871 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.176904 May 25 17:12:16.817460 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 213/446] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:16 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:12:17.352618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-606bb9aa-5d60-433d-a48f-d8a48882ea72 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:17.353273 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-606bb9aa-5d60-433d-a48f-d8a48882ea72 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:17.360129 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-606bb9aa-5d60-433d-a48f-d8a48882ea72 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:17.360581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-606bb9aa-5d60-433d-a48f-d8a48882ea72 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:17.361381 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-606bb9aa-5d60-433d-a48f-d8a48882ea72 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:17.362224 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-606bb9aa-5d60-433d-a48f-d8a48882ea72 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:17.495891 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-606bb9aa-5d60-433d-a48f-d8a48882ea72 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:17.506416 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-606bb9aa-5d60-433d-a48f-d8a48882ea72 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.157433 May 25 17:12:17.507014 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 234/447] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:17 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:17.835227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d36460b9-270c-4bdb-8f6e-182ff419f943 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:17.835837 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d36460b9-270c-4bdb-8f6e-182ff419f943 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:17.843823 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d36460b9-270c-4bdb-8f6e-182ff419f943 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:17.844276 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d36460b9-270c-4bdb-8f6e-182ff419f943 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:17.845171 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d36460b9-270c-4bdb-8f6e-182ff419f943 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:17.845814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d36460b9-270c-4bdb-8f6e-182ff419f943 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:17.861988 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:17.977552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d36460b9-270c-4bdb-8f6e-182ff419f943 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:17.985959 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d36460b9-270c-4bdb-8f6e-182ff419f943 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:17.987455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d36460b9-270c-4bdb-8f6e-182ff419f943 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:17.988609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d36460b9-270c-4bdb-8f6e-182ff419f943 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.157321 May 25 17:12:17.989193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 214/448] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:17 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:18.467934 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-923ad94e-196a-428e-b47b-0f082c83c1ad tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "726daffb-8d13-41d2-ab65-449d5a878ecb", "device": "/dev/sdb"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:12:18.469597 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-923ad94e-196a-428e-b47b-0f082c83c1ad tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:18.476007 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-923ad94e-196a-428e-b47b-0f082c83c1ad tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:18.476454 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-923ad94e-196a-428e-b47b-0f082c83c1ad tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:18.477241 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-923ad94e-196a-428e-b47b-0f082c83c1ad tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:18.477672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-923ad94e-196a-428e-b47b-0f082c83c1ad tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:18.523444 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-385ad5c1-abb3-4a26-be6f-728f5ae7cf53 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:18.524048 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-385ad5c1-abb3-4a26-be6f-728f5ae7cf53 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:18.530749 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-385ad5c1-abb3-4a26-be6f-728f5ae7cf53 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:18.531211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-385ad5c1-abb3-4a26-be6f-728f5ae7cf53 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:18.532018 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-385ad5c1-abb3-4a26-be6f-728f5ae7cf53 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:18.532457 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-385ad5c1-abb3-4a26-be6f-728f5ae7cf53 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:18.660654 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-385ad5c1-abb3-4a26-be6f-728f5ae7cf53 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:18.668076 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-385ad5c1-abb3-4a26-be6f-728f5ae7cf53 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.148679 May 25 17:12:18.668712 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 215/449] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:18 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:12:19.007139 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f5a854f2-cd3d-40c6-9118-bfaa63430a91 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:19.007732 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f5a854f2-cd3d-40c6-9118-bfaa63430a91 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:19.014593 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f5a854f2-cd3d-40c6-9118-bfaa63430a91 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:19.015043 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f5a854f2-cd3d-40c6-9118-bfaa63430a91 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:19.015838 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f5a854f2-cd3d-40c6-9118-bfaa63430a91 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:19.016271 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f5a854f2-cd3d-40c6-9118-bfaa63430a91 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:19.149605 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f5a854f2-cd3d-40c6-9118-bfaa63430a91 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:19.158471 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f5a854f2-cd3d-40c6-9118-bfaa63430a91 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:19.159992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f5a854f2-cd3d-40c6-9118-bfaa63430a91 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:19.161186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f5a854f2-cd3d-40c6-9118-bfaa63430a91 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.158140 May 25 17:12:19.161751 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 216/450] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:19 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:12:19.686786 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-38a6e70c-797f-4033-af27-652a7875cdbd tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:19.687556 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-38a6e70c-797f-4033-af27-652a7875cdbd tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:19.693899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38a6e70c-797f-4033-af27-652a7875cdbd tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:19.694568 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38a6e70c-797f-4033-af27-652a7875cdbd tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:19.695331 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38a6e70c-797f-4033-af27-652a7875cdbd tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:19.695770 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38a6e70c-797f-4033-af27-652a7875cdbd tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:19.731515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-923ad94e-196a-428e-b47b-0f082c83c1ad tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "POST /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.267406 May 25 17:12:19.732300 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 235/451] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:12:18 2022] POST /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a/os-volume_attachments => generated 194 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:12:19.836124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-38a6e70c-797f-4033-af27-652a7875cdbd tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:19.843573 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-38a6e70c-797f-4033-af27-652a7875cdbd tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.161074 May 25 17:12:19.844120 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 217/452] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:19 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:20.180745 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-827a1447-81b9-4657-8d30-ac413bce3e70 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:20.181334 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-827a1447-81b9-4657-8d30-ac413bce3e70 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:20.189036 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-827a1447-81b9-4657-8d30-ac413bce3e70 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:20.189490 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-827a1447-81b9-4657-8d30-ac413bce3e70 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:20.190311 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-827a1447-81b9-4657-8d30-ac413bce3e70 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:20.190740 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-827a1447-81b9-4657-8d30-ac413bce3e70 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:20.331200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-827a1447-81b9-4657-8d30-ac413bce3e70 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:20.339494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-827a1447-81b9-4657-8d30-ac413bce3e70 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:20.341678 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-827a1447-81b9-4657-8d30-ac413bce3e70 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:20.343045 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-827a1447-81b9-4657-8d30-ac413bce3e70 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.166806 May 25 17:12:20.343602 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 236/453] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:20 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:20.859343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-19bb7f63-bcbb-4e23-852a-43cbddc3ebd0 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:20.859954 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-19bb7f63-bcbb-4e23-852a-43cbddc3ebd0 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:20.866479 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19bb7f63-bcbb-4e23-852a-43cbddc3ebd0 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:20.866927 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19bb7f63-bcbb-4e23-852a-43cbddc3ebd0 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:20.867694 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19bb7f63-bcbb-4e23-852a-43cbddc3ebd0 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:20.868131 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19bb7f63-bcbb-4e23-852a-43cbddc3ebd0 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:21.006009 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-19bb7f63-bcbb-4e23-852a-43cbddc3ebd0 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:21.015036 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-19bb7f63-bcbb-4e23-852a-43cbddc3ebd0 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.159700 May 25 17:12:21.015603 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 218/454] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:20 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:21.361573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-bfc7aec9-3481-4129-be6e-6f0d46a2bb63 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:21.362178 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-bfc7aec9-3481-4129-be6e-6f0d46a2bb63 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:21.368510 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bfc7aec9-3481-4129-be6e-6f0d46a2bb63 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:21.369195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bfc7aec9-3481-4129-be6e-6f0d46a2bb63 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:21.369775 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bfc7aec9-3481-4129-be6e-6f0d46a2bb63 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:21.370207 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bfc7aec9-3481-4129-be6e-6f0d46a2bb63 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:21.503968 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-bfc7aec9-3481-4129-be6e-6f0d46a2bb63 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:21.513408 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-bfc7aec9-3481-4129-be6e-6f0d46a2bb63 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:21.515479 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-bfc7aec9-3481-4129-be6e-6f0d46a2bb63 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:21.516903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-bfc7aec9-3481-4129-be6e-6f0d46a2bb63 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.159348 May 25 17:12:21.519167 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 237/455] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:21 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:22.031549 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-11842c75-57b4-496a-bcdd-14ab4ca355dc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:22.032162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-11842c75-57b4-496a-bcdd-14ab4ca355dc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:22.038763 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-11842c75-57b4-496a-bcdd-14ab4ca355dc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:22.039216 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-11842c75-57b4-496a-bcdd-14ab4ca355dc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:22.039984 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-11842c75-57b4-496a-bcdd-14ab4ca355dc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:22.040419 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-11842c75-57b4-496a-bcdd-14ab4ca355dc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:22.168487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-11842c75-57b4-496a-bcdd-14ab4ca355dc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:22.175924 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-11842c75-57b4-496a-bcdd-14ab4ca355dc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.148409 May 25 17:12:22.176479 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 219/456] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:22 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:22.535742 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-50a91590-b740-49c1-953f-845c956d51a3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:22.536272 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-50a91590-b740-49c1-953f-845c956d51a3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:22.542817 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-50a91590-b740-49c1-953f-845c956d51a3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:22.543270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-50a91590-b740-49c1-953f-845c956d51a3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:22.544556 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-50a91590-b740-49c1-953f-845c956d51a3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:22.545030 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-50a91590-b740-49c1-953f-845c956d51a3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:22.673981 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-50a91590-b740-49c1-953f-845c956d51a3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:22.682637 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-50a91590-b740-49c1-953f-845c956d51a3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:22.684139 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-50a91590-b740-49c1-953f-845c956d51a3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:22.685773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-50a91590-b740-49c1-953f-845c956d51a3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.153966 May 25 17:12:22.686351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 238/457] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:22 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:23.193651 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-830aaab0-276e-413b-9b8d-1e4ec23acf94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:23.194190 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-830aaab0-276e-413b-9b8d-1e4ec23acf94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:23.201473 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-830aaab0-276e-413b-9b8d-1e4ec23acf94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:23.201924 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-830aaab0-276e-413b-9b8d-1e4ec23acf94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:23.202691 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-830aaab0-276e-413b-9b8d-1e4ec23acf94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:23.203130 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-830aaab0-276e-413b-9b8d-1e4ec23acf94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:23.331477 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-830aaab0-276e-413b-9b8d-1e4ec23acf94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:23.338876 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-830aaab0-276e-413b-9b8d-1e4ec23acf94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.149200 May 25 17:12:23.339444 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 220/458] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:23 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:23.517392 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-a3fbded3-911c-493c-a94f-1ef510ab83e3 req-7dd61463-4909-48f0-a0f9-933143f143e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99e2d9c-ac45-4a8e-8076-faaf830c29e0", "name": "network-vif-plugged", "status": "completed", "tag": "fa9d31d9-985b-4772-a564-1cbeee313f84"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:12:23.525946 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-a3fbded3-911c-493c-a94f-1ef510ab83e3 req-7dd61463-4909-48f0-a0f9-933143f143e8 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:23.526458 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-a3fbded3-911c-493c-a94f-1ef510ab83e3 req-7dd61463-4909-48f0-a0f9-933143f143e8 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:23.539034 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-a3fbded3-911c-493c-a94f-1ef510ab83e3 req-7dd61463-4909-48f0-a0f9-933143f143e8 service nova] Creating event network-vif-plugged:fa9d31d9-985b-4772-a564-1cbeee313f84 for instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 on hv-cinder-84330 May 25 17:12:23.544892 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-a3fbded3-911c-493c-a94f-1ef510ab83e3 req-7dd61463-4909-48f0-a0f9-933143f143e8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032188 May 25 17:12:23.545608 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 239/459] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:12:23.703989 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-83d8d262-c0e1-446b-8fc0-8f5355aee409 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:23.704588 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-83d8d262-c0e1-446b-8fc0-8f5355aee409 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:23.706573 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:23.711958 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83d8d262-c0e1-446b-8fc0-8f5355aee409 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:23.712410 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83d8d262-c0e1-446b-8fc0-8f5355aee409 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:23.713214 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83d8d262-c0e1-446b-8fc0-8f5355aee409 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:23.713656 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83d8d262-c0e1-446b-8fc0-8f5355aee409 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:23.846578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-83d8d262-c0e1-446b-8fc0-8f5355aee409 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:23.854930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-83d8d262-c0e1-446b-8fc0-8f5355aee409 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:23.857480 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-83d8d262-c0e1-446b-8fc0-8f5355aee409 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:23.858812 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-83d8d262-c0e1-446b-8fc0-8f5355aee409 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.159288 May 25 17:12:23.859379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 221/460] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:23 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:24.356578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e920195a-e497-4e08-995f-71dd31d3aa39 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:24.357334 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e920195a-e497-4e08-995f-71dd31d3aa39 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:24.359262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=68 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:24.364814 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e920195a-e497-4e08-995f-71dd31d3aa39 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:24.365269 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e920195a-e497-4e08-995f-71dd31d3aa39 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:24.366031 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e920195a-e497-4e08-995f-71dd31d3aa39 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:24.366472 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e920195a-e497-4e08-995f-71dd31d3aa39 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:24.500964 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e920195a-e497-4e08-995f-71dd31d3aa39 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:24.508496 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e920195a-e497-4e08-995f-71dd31d3aa39 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.156199 May 25 17:12:24.509097 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 240/461] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:24 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:24.876451 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6c89227a-eb77-43db-ab71-a5b12e467343 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:24.877088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6c89227a-eb77-43db-ab71-a5b12e467343 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:24.883534 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c89227a-eb77-43db-ab71-a5b12e467343 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:24.883982 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c89227a-eb77-43db-ab71-a5b12e467343 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:24.884767 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c89227a-eb77-43db-ab71-a5b12e467343 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:24.885211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c89227a-eb77-43db-ab71-a5b12e467343 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:25.018127 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6c89227a-eb77-43db-ab71-a5b12e467343 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:25.026736 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6c89227a-eb77-43db-ab71-a5b12e467343 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:25.028837 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6c89227a-eb77-43db-ab71-a5b12e467343 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:25.030202 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6c89227a-eb77-43db-ab71-a5b12e467343 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.158041 May 25 17:12:25.030764 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 222/462] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:24 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:25.526652 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-121355a6-d8e7-4d7f-aa94-f25473b2c185 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:25.527299 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-121355a6-d8e7-4d7f-aa94-f25473b2c185 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:25.535029 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-121355a6-d8e7-4d7f-aa94-f25473b2c185 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:25.535482 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-121355a6-d8e7-4d7f-aa94-f25473b2c185 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:25.536256 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-121355a6-d8e7-4d7f-aa94-f25473b2c185 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:25.536705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-121355a6-d8e7-4d7f-aa94-f25473b2c185 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:25.676361 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-121355a6-d8e7-4d7f-aa94-f25473b2c185 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:25.683596 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-121355a6-d8e7-4d7f-aa94-f25473b2c185 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.160794 May 25 17:12:25.684169 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 241/463] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:25 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:26.049341 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-91e18aa0-bd92-4807-98ca-e73842142360 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:26.049885 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-91e18aa0-bd92-4807-98ca-e73842142360 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:26.056412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-91e18aa0-bd92-4807-98ca-e73842142360 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:26.056898 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-91e18aa0-bd92-4807-98ca-e73842142360 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:26.057660 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-91e18aa0-bd92-4807-98ca-e73842142360 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:26.058098 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-91e18aa0-bd92-4807-98ca-e73842142360 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:26.230350 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-91e18aa0-bd92-4807-98ca-e73842142360 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:26.241742 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-91e18aa0-bd92-4807-98ca-e73842142360 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:26.243270 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-91e18aa0-bd92-4807-98ca-e73842142360 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:26.244418 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-91e18aa0-bd92-4807-98ca-e73842142360 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1807 microversion: 2.20 time: 0.199032 May 25 17:12:26.255877 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 223/464] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:26 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:26.701672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c5c8202a-077b-4386-ba43-cdb796a22e4d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:26.702279 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c5c8202a-077b-4386-ba43-cdb796a22e4d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:26.709124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5c8202a-077b-4386-ba43-cdb796a22e4d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:26.709574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5c8202a-077b-4386-ba43-cdb796a22e4d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:26.710337 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5c8202a-077b-4386-ba43-cdb796a22e4d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:26.710769 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5c8202a-077b-4386-ba43-cdb796a22e4d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:26.847594 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c5c8202a-077b-4386-ba43-cdb796a22e4d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:26.857549 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c5c8202a-077b-4386-ba43-cdb796a22e4d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.160335 May 25 17:12:26.858131 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 242/465] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:26 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:27.263451 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cf95e4d6-69c5-46cf-9eb2-be8cbedc6e53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:27.264057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cf95e4d6-69c5-46cf-9eb2-be8cbedc6e53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:27.270585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf95e4d6-69c5-46cf-9eb2-be8cbedc6e53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:27.271037 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf95e4d6-69c5-46cf-9eb2-be8cbedc6e53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:27.271798 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf95e4d6-69c5-46cf-9eb2-be8cbedc6e53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:27.272236 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf95e4d6-69c5-46cf-9eb2-be8cbedc6e53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:27.418031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cf95e4d6-69c5-46cf-9eb2-be8cbedc6e53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:27.428120 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cf95e4d6-69c5-46cf-9eb2-be8cbedc6e53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:27.430002 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cf95e4d6-69c5-46cf-9eb2-be8cbedc6e53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:27.431389 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cf95e4d6-69c5-46cf-9eb2-be8cbedc6e53 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1794 microversion: 2.20 time: 0.172281 May 25 17:12:27.432091 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 224/466] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:12:27 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1794 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:12:27.696256 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-0f6f93a0-c435-4f9d-9829-70b9b111d493 req-782ee989-2b1f-4d2d-a1c7-7d8d6e20df69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b7231c-3070-4cb3-b6a2-732af750f6f4", "name": "network-vif-plugged", "status": "completed", "tag": "fc321a82-a17f-45cd-ae89-dea85055e57c"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:12:27.705718 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-0f6f93a0-c435-4f9d-9829-70b9b111d493 req-782ee989-2b1f-4d2d-a1c7-7d8d6e20df69 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:27.706304 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-0f6f93a0-c435-4f9d-9829-70b9b111d493 req-782ee989-2b1f-4d2d-a1c7-7d8d6e20df69 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:27.719638 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-0f6f93a0-c435-4f9d-9829-70b9b111d493 req-782ee989-2b1f-4d2d-a1c7-7d8d6e20df69 service nova] Creating event network-vif-plugged:fc321a82-a17f-45cd-ae89-dea85055e57c for instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 on hv-cinder-84330 May 25 17:12:27.724576 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-0f6f93a0-c435-4f9d-9829-70b9b111d493 req-782ee989-2b1f-4d2d-a1c7-7d8d6e20df69 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032022 May 25 17:12:27.725594 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 243/467] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:12:27.874706 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-85fc75e7-dc69-4486-9cc6-44829d86b545 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:27.875290 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-85fc75e7-dc69-4486-9cc6-44829d86b545 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:27.881266 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85fc75e7-dc69-4486-9cc6-44829d86b545 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:27.881710 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85fc75e7-dc69-4486-9cc6-44829d86b545 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:27.882458 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85fc75e7-dc69-4486-9cc6-44829d86b545 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:27.882886 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85fc75e7-dc69-4486-9cc6-44829d86b545 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:28.047382 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-85fc75e7-dc69-4486-9cc6-44829d86b545 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:28.054828 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-85fc75e7-dc69-4486-9cc6-44829d86b545 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.184482 May 25 17:12:28.055390 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 225/468] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:27 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:29.072800 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4e59e117-0f14-43ae-986d-260e7fa651c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:29.073493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4e59e117-0f14-43ae-986d-260e7fa651c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:29.080710 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4e59e117-0f14-43ae-986d-260e7fa651c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:29.081169 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4e59e117-0f14-43ae-986d-260e7fa651c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:29.081930 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4e59e117-0f14-43ae-986d-260e7fa651c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:29.082373 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4e59e117-0f14-43ae-986d-260e7fa651c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:29.100403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:29.213678 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4e59e117-0f14-43ae-986d-260e7fa651c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:29.222083 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4e59e117-0f14-43ae-986d-260e7fa651c3 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.153452 May 25 17:12:29.222644 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 244/469] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:29 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:30.238503 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-22b286c8-cf0e-4b79-b7ff-d6a6e74065e8 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:30.239099 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-22b286c8-cf0e-4b79-b7ff-d6a6e74065e8 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:30.245666 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22b286c8-cf0e-4b79-b7ff-d6a6e74065e8 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:30.246110 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22b286c8-cf0e-4b79-b7ff-d6a6e74065e8 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:30.247424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22b286c8-cf0e-4b79-b7ff-d6a6e74065e8 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:30.247858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22b286c8-cf0e-4b79-b7ff-d6a6e74065e8 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:30.388083 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-22b286c8-cf0e-4b79-b7ff-d6a6e74065e8 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:30.396313 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-22b286c8-cf0e-4b79-b7ff-d6a6e74065e8 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.161607 May 25 17:12:30.396969 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 226/470] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:30 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:31.413836 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d8ed43ec-34f1-4f76-970d-1837f36dbfa1 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:31.414441 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d8ed43ec-34f1-4f76-970d-1837f36dbfa1 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:31.422016 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d8ed43ec-34f1-4f76-970d-1837f36dbfa1 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:31.422467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d8ed43ec-34f1-4f76-970d-1837f36dbfa1 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:31.423228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d8ed43ec-34f1-4f76-970d-1837f36dbfa1 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:31.423664 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d8ed43ec-34f1-4f76-970d-1837f36dbfa1 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:31.558354 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d8ed43ec-34f1-4f76-970d-1837f36dbfa1 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:31.566873 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d8ed43ec-34f1-4f76-970d-1837f36dbfa1 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1261 microversion: 2.1 time: 0.156964 May 25 17:12:31.567438 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 245/471] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:31 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:32.583022 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b2860d07-9b1c-437e-bf30-69982e1666fc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:32.583636 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b2860d07-9b1c-437e-bf30-69982e1666fc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:32.590147 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2860d07-9b1c-437e-bf30-69982e1666fc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:32.590623 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2860d07-9b1c-437e-bf30-69982e1666fc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:32.591389 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2860d07-9b1c-437e-bf30-69982e1666fc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:32.591825 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2860d07-9b1c-437e-bf30-69982e1666fc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:32.742164 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b2860d07-9b1c-437e-bf30-69982e1666fc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:32.751816 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b2860d07-9b1c-437e-bf30-69982e1666fc tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1444 microversion: 2.1 time: 0.172496 May 25 17:12:32.752570 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 227/472] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:32 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1444 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:32.770639 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-45857129-ba2c-462c-ab24-6e2e2f7ba403 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:32.771278 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-45857129-ba2c-462c-ab24-6e2e2f7ba403 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:32.777614 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-45857129-ba2c-462c-ab24-6e2e2f7ba403 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:32.778151 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-45857129-ba2c-462c-ab24-6e2e2f7ba403 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:32.778977 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-45857129-ba2c-462c-ab24-6e2e2f7ba403 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:32.779432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-45857129-ba2c-462c-ab24-6e2e2f7ba403 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:32.920616 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-45857129-ba2c-462c-ab24-6e2e2f7ba403 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:32.928177 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-45857129-ba2c-462c-ab24-6e2e2f7ba403 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1444 microversion: 2.1 time: 0.162746 May 25 17:12:32.928762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 246/473] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:32 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:34.694883 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-bb222652-47d4-46b0-b533-a6595de03c08 req-1d039952-c2ce-4bc1-ab51-73793bb90885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b7231c-3070-4cb3-b6a2-732af750f6f4", "tag": "fc321a82-a17f-45cd-ae89-dea85055e57c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:12:34.704094 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-bb222652-47d4-46b0-b533-a6595de03c08 req-1d039952-c2ce-4bc1-ab51-73793bb90885 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:34.704609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-bb222652-47d4-46b0-b533-a6595de03c08 req-1d039952-c2ce-4bc1-ab51-73793bb90885 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:34.717924 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-bb222652-47d4-46b0-b533-a6595de03c08 req-1d039952-c2ce-4bc1-ab51-73793bb90885 service nova] Creating event network-changed:fc321a82-a17f-45cd-ae89-dea85055e57c for instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 on hv-cinder-84330 May 25 17:12:34.722961 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-bb222652-47d4-46b0-b533-a6595de03c08 req-1d039952-c2ce-4bc1-ab51-73793bb90885 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031752 May 25 17:12:34.723591 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 228/474] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:12:44.473114 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8d42d945-f5e2-4451-a7ac-c839228d9ff3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:44.473602 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8d42d945-f5e2-4451-a7ac-c839228d9ff3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:44.476090 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=13 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:44.476787 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=14 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:44.483284 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8d42d945-f5e2-4451-a7ac-c839228d9ff3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:44.483735 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8d42d945-f5e2-4451-a7ac-c839228d9ff3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:44.484499 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8d42d945-f5e2-4451-a7ac-c839228d9ff3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:44.484962 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8d42d945-f5e2-4451-a7ac-c839228d9ff3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:44.610824 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-8d42d945-f5e2-4451-a7ac-c839228d9ff3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lazy-loading 'services' on Instance uuid 7eac90cb-0606-4589-b405-8d607816944a {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:12:44.724034 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8d42d945-f5e2-4451-a7ac-c839228d9ff3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "DELETE /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a/os-volume_attachments/726daffb-8d13-41d2-ab65-449d5a878ecb" status: 202 len: 0 microversion: 2.1 time: 0.254700 May 25 17:12:44.724660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 247/475] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:12:44 2022] DELETE /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a/os-volume_attachments/726daffb-8d13-41d2-ab65-449d5a878ecb => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:12:45.843084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=15 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:45.843848 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=83 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:45.848186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8ab60ee5-c4c8-4b25-b8ce-e9978c581948 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:45.848829 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8ab60ee5-c4c8-4b25-b8ce-e9978c581948 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:45.857632 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ab60ee5-c4c8-4b25-b8ce-e9978c581948 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:45.858087 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ab60ee5-c4c8-4b25-b8ce-e9978c581948 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:45.858862 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ab60ee5-c4c8-4b25-b8ce-e9978c581948 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:45.859296 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ab60ee5-c4c8-4b25-b8ce-e9978c581948 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:45.883816 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8ab60ee5-c4c8-4b25-b8ce-e9978c581948 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:12:45.958871 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8ab60ee5-c4c8-4b25-b8ce-e9978c581948 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "DELETE /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 204 len: 0 microversion: 2.1 time: 0.116969 May 25 17:12:45.959628 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 229/476] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:12:45 2022] DELETE /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:12:45.969740 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3bf857d4-f0b1-4192-8d17-0127ce3d16ef tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:45.971375 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3bf857d4-f0b1-4192-8d17-0127ce3d16ef tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:45.978107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3bf857d4-f0b1-4192-8d17-0127ce3d16ef tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:45.978558 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3bf857d4-f0b1-4192-8d17-0127ce3d16ef tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:45.979355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3bf857d4-f0b1-4192-8d17-0127ce3d16ef tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:45.979788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3bf857d4-f0b1-4192-8d17-0127ce3d16ef tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:46.111257 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3bf857d4-f0b1-4192-8d17-0127ce3d16ef tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:46.118743 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3bf857d4-f0b1-4192-8d17-0127ce3d16ef tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1514 microversion: 2.1 time: 0.154710 May 25 17:12:46.119301 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 248/477] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:45 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:47.138104 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cf313eb2-0130-4b69-93bc-e9bda35add4c tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:47.138835 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cf313eb2-0130-4b69-93bc-e9bda35add4c tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:47.145305 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf313eb2-0130-4b69-93bc-e9bda35add4c tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:47.145760 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf313eb2-0130-4b69-93bc-e9bda35add4c tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:47.146529 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf313eb2-0130-4b69-93bc-e9bda35add4c tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:47.146970 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf313eb2-0130-4b69-93bc-e9bda35add4c tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:47.275717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cf313eb2-0130-4b69-93bc-e9bda35add4c tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:47.283875 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cf313eb2-0130-4b69-93bc-e9bda35add4c tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1514 microversion: 2.1 time: 0.150579 May 25 17:12:47.284436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 230/478] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:47 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:48.300692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e84f7361-13c0-4adf-9ca6-19281ec5ae37 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:48.301311 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e84f7361-13c0-4adf-9ca6-19281ec5ae37 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:48.307838 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e84f7361-13c0-4adf-9ca6-19281ec5ae37 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:48.308915 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e84f7361-13c0-4adf-9ca6-19281ec5ae37 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:48.309703 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e84f7361-13c0-4adf-9ca6-19281ec5ae37 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:48.310136 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e84f7361-13c0-4adf-9ca6-19281ec5ae37 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:48.446980 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e84f7361-13c0-4adf-9ca6-19281ec5ae37 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:48.455851 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e84f7361-13c0-4adf-9ca6-19281ec5ae37 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 200 len: 1514 microversion: 2.1 time: 0.159080 May 25 17:12:48.456700 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 249/479] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:48 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:48.540995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-f24f9429-93bd-403d-b1b3-fb43c6fb5a63 req-b4d87ae7-f7ae-478c-8215-8f0f77e71b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eac90cb-0606-4589-b405-8d607816944a", "name": "network-vif-deleted", "tag": "15213f99-cfc9-459a-abff-c83378d5b919"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:12:48.551487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-f24f9429-93bd-403d-b1b3-fb43c6fb5a63 req-b4d87ae7-f7ae-478c-8215-8f0f77e71b3b service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:48.551943 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-f24f9429-93bd-403d-b1b3-fb43c6fb5a63 req-b4d87ae7-f7ae-478c-8215-8f0f77e71b3b service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:48.564156 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-f24f9429-93bd-403d-b1b3-fb43c6fb5a63 req-b4d87ae7-f7ae-478c-8215-8f0f77e71b3b service nova] Creating event network-vif-deleted:15213f99-cfc9-459a-abff-c83378d5b919 for instance 7eac90cb-0606-4589-b405-8d607816944a on hv-cinder-84330 May 25 17:12:48.570407 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-f24f9429-93bd-403d-b1b3-fb43c6fb5a63 req-b4d87ae7-f7ae-478c-8215-8f0f77e71b3b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033009 May 25 17:12:48.571013 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 231/480] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:12:49.474141 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-cb83dddf-5bfe-4e4e-a7c8-ec8f3ff0fb79 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:49.474760 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-cb83dddf-5bfe-4e4e-a7c8-ec8f3ff0fb79 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 7eac90cb-0606-4589-b405-8d607816944a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:49.481289 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cb83dddf-5bfe-4e4e-a7c8-ec8f3ff0fb79 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:49.481741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cb83dddf-5bfe-4e4e-a7c8-ec8f3ff0fb79 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:49.482516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cb83dddf-5bfe-4e4e-a7c8-ec8f3ff0fb79 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:49.482956 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cb83dddf-5bfe-4e4e-a7c8-ec8f3ff0fb79 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:49.498954 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-cb83dddf-5bfe-4e4e-a7c8-ec8f3ff0fb79 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] HTTP exception thrown: Instance 7eac90cb-0606-4589-b405-8d607816944a could not be found. May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-cb83dddf-5bfe-4e4e-a7c8-ec8f3ff0fb79 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Request method failure captured: May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a HTTP/1.1 May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmNEArOc3-uj0jA-Lyu08Ny0GosCOuFS7lxNQyeT-6uyiIeQKS3PCW8dGaNxNHb5wf72Sn1maSk3hSfNv9nbyXLpTKZ6OHfy-znGH49F8UFfCVt7xFW95ZaFQN7NMVYJBLcmuyNwYb1khSW_JymT22bfvBB-1NxUwR7yLKkXlGsgiTI May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 0f97d685bab047d8bbcd4c9e804f7d82 May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-VolumesSnapshotTestJSON-468727163 May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:12:49.500567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_0f97d685bab047d8bbcd4c9e804f7d82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/0f97d685bab047d8bbcd4c9e804f7d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/0f97d685bab047d8bbcd4c9e804f7d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/0f97d685bab047d8bbcd4c9e804f7d82"}]}] May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-VolumesSnapshotTestJSON-468727163 May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 0f97d685bab047d8bbcd4c9e804f7d82 May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-468727163 May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-VolumesSnapshotTestJSON-468727163-project May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 483fc20c75df406983982ee5a21b4913 May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-VolumesSnapshotTestJSON-468727163-project May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 7eac90cb-0606-4589-b405-8d607816944a could not be found. May 25 17:12:49.502078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '7eac90cb-0606-4589-b405-8d607816944a'} May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eac90cb-0606-4589-b405-8d607816944a could not be found. May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:12:49.502885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eac90cb-0606-4589-b405-8d607816944a could not be found. May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eac90cb-0606-4589-b405-8d607816944a could not be found. May 25 17:12:49.504422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:12:49.505917 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-cb83dddf-5bfe-4e4e-a7c8-ec8f3ff0fb79 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Returning 404 to user: Instance 7eac90cb-0606-4589-b405-8d607816944a could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:12:49.505917 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-cb83dddf-5bfe-4e4e-a7c8-ec8f3ff0fb79 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a" status: 404 len: 111 microversion: 2.1 time: 0.031720 May 25 17:12:49.505917 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 250/481] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:49 2022] GET /compute/v2.1/servers/7eac90cb-0606-4589-b405-8d607816944a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:12:52.680346 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-08f6b681-c7b9-4219-88d5-1ae840ce7f28 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa48b200-1aa3-4e4b-b165-cc159649fe16"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:12:52.681536 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-08f6b681-c7b9-4219-88d5-1ae840ce7f28 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:52.689163 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-08f6b681-c7b9-4219-88d5-1ae840ce7f28 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:52.689610 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-08f6b681-c7b9-4219-88d5-1ae840ce7f28 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:52.690373 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-08f6b681-c7b9-4219-88d5-1ae840ce7f28 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:52.690804 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-08f6b681-c7b9-4219-88d5-1ae840ce7f28 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:52.943783 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-08f6b681-c7b9-4219-88d5-1ae840ce7f28 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267594 May 25 17:12:52.950702 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 232/482] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:12:52 2022] POST /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:12:53.643743 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:12:53.644232 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Wed May 25 17:12:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:12:57.310091 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-827238834", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "networks": [{"uuid": "2300e90b-d27f-4f3f-bb1d-d819acec0222"}]}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:12:57.361899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.network.neutron [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] validate_networks() for [('2300e90b-d27f-4f3f-bb1d-d819acec0222', None, None, None, None, None)] {{(pid=117695) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:12:57.707020 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Flavor limits 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:12:57.707451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Image limits 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:12:57.707931 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Flavor pref 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:12:57.708345 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Image pref 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:12:57.708901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:12:57.717851 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:57.718243 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:57.719047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:57.719486 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:57.736518 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Getting quotas for project 0f97d685bab047d8bbcd4c9e804f7d82. Resources: {'ram', 'instances', 'cores'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:12:57.740487 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Getting quotas for user 483fc20c75df406983982ee5a21b4913 and project 0f97d685bab047d8bbcd4c9e804f7d82. Resources: {'ram', 'instances', 'cores'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:12:57.752262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Going to run 1 instances... {{(pid=117695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:12:57.754549 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:12:57.799669 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0aafb12d-ed4b-4689-b0a3-782e726626a8 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494022 May 25 17:12:57.800307 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 251/483] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:12:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:12:57.811392 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-df346a10-7ea4-404f-9c31-d64ca0c6ce13 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:57.812095 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-df346a10-7ea4-404f-9c31-d64ca0c6ce13 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:57.866248 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-df346a10-7ea4-404f-9c31-d64ca0c6ce13 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:57.873386 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-df346a10-7ea4-404f-9c31-d64ca0c6ce13 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1218 microversion: 2.1 time: 0.066739 May 25 17:12:57.873955 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 233/484] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:57 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:58.891565 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ccfbc8c5-da3d-49c7-b57c-cefd8d2375ee tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:58.892175 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ccfbc8c5-da3d-49c7-b57c-cefd8d2375ee tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:58.898982 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ccfbc8c5-da3d-49c7-b57c-cefd8d2375ee tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:58.899433 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ccfbc8c5-da3d-49c7-b57c-cefd8d2375ee tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:58.900201 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ccfbc8c5-da3d-49c7-b57c-cefd8d2375ee tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:58.900643 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ccfbc8c5-da3d-49c7-b57c-cefd8d2375ee tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:58.963337 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ccfbc8c5-da3d-49c7-b57c-cefd8d2375ee tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:12:58.971345 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ccfbc8c5-da3d-49c7-b57c-cefd8d2375ee tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1270 microversion: 2.1 time: 0.084851 May 25 17:12:58.971901 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 252/485] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:58 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:12:59.001649 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f9e92a0f-0a4f-4bf9-b4b2-efd73e98aa90 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:59.002170 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f9e92a0f-0a4f-4bf9-b4b2-efd73e98aa90 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:59.008970 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9e92a0f-0a4f-4bf9-b4b2-efd73e98aa90 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:59.009425 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9e92a0f-0a4f-4bf9-b4b2-efd73e98aa90 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:59.010190 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9e92a0f-0a4f-4bf9-b4b2-efd73e98aa90 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:59.010629 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9e92a0f-0a4f-4bf9-b4b2-efd73e98aa90 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:59.133249 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-f9e92a0f-0a4f-4bf9-b4b2-efd73e98aa90 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lazy-loading 'services' on Instance uuid 5ecb9b07-e50d-4926-b95d-af40c6093d83 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:12:59.244296 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f9e92a0f-0a4f-4bf9-b4b2-efd73e98aa90 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/os-volume_attachments/265bf648-f2fd-41dd-aee8-b5517e9e9d1b" status: 202 len: 0 microversion: 2.1 time: 0.246377 May 25 17:12:59.244981 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 234/486] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:12:58 2022] DELETE /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/os-volume_attachments/265bf648-f2fd-41dd-aee8-b5517e9e9d1b => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:12:59.989038 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7c19ac02-c699-4861-8e4f-5b7aa367ab0a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:12:59.990273 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7c19ac02-c699-4861-8e4f-5b7aa367ab0a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:12:59.998042 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7c19ac02-c699-4861-8e4f-5b7aa367ab0a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:59.998492 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7c19ac02-c699-4861-8e4f-5b7aa367ab0a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:12:59.999256 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7c19ac02-c699-4861-8e4f-5b7aa367ab0a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:12:59.999698 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7c19ac02-c699-4861-8e4f-5b7aa367ab0a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:00.063542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7c19ac02-c699-4861-8e4f-5b7aa367ab0a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:00.071268 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7c19ac02-c699-4861-8e4f-5b7aa367ab0a tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1276 microversion: 2.1 time: 0.086074 May 25 17:13:00.071838 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 253/487] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:12:59 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:00.484586 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-170c6128-32bb-44db-8099-a31ed322b23e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:00.485693 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-170c6128-32bb-44db-8099-a31ed322b23e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:00.492447 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-170c6128-32bb-44db-8099-a31ed322b23e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:00.492928 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-170c6128-32bb-44db-8099-a31ed322b23e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:00.493698 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-170c6128-32bb-44db-8099-a31ed322b23e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:00.494139 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-170c6128-32bb-44db-8099-a31ed322b23e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:00.517806 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-170c6128-32bb-44db-8099-a31ed322b23e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lazy-loading 'flavor' on Instance uuid 377df57f-c46c-4107-99f6-3d8ce8707e39 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:13:00.652615 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-170c6128-32bb-44db-8099-a31ed322b23e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/action" status: 200 len: 32 microversion: 2.1 time: 0.173266 May 25 17:13:00.653258 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 235/488] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:13:00 2022] POST /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 17:13:00.662343 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-454315c8-8c61-4990-912d-fe41f82ecd4e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:00.663181 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-454315c8-8c61-4990-912d-fe41f82ecd4e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:00.670388 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-454315c8-8c61-4990-912d-fe41f82ecd4e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:00.671312 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-454315c8-8c61-4990-912d-fe41f82ecd4e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:00.672281 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-454315c8-8c61-4990-912d-fe41f82ecd4e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:00.672749 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-454315c8-8c61-4990-912d-fe41f82ecd4e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:00.821171 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-454315c8-8c61-4990-912d-fe41f82ecd4e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:00.830881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-454315c8-8c61-4990-912d-fe41f82ecd4e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.172384 May 25 17:13:00.831458 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 254/489] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:00 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:01.091244 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-50d8314a-c327-4132-8817-e62057692703 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:01.092205 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-50d8314a-c327-4132-8817-e62057692703 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:01.098617 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50d8314a-c327-4132-8817-e62057692703 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:01.099068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50d8314a-c327-4132-8817-e62057692703 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:01.099836 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50d8314a-c327-4132-8817-e62057692703 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:01.100272 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50d8314a-c327-4132-8817-e62057692703 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:01.405619 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-50d8314a-c327-4132-8817-e62057692703 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:01.423269 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-50d8314a-c327-4132-8817-e62057692703 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1318 microversion: 2.1 time: 0.337853 May 25 17:13:01.424150 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 236/490] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:01 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:01.428940 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8b686078-70fe-43c3-b74f-5983dd4bedbd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:01.435767 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8b686078-70fe-43c3-b74f-5983dd4bedbd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:01.436225 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8b686078-70fe-43c3-b74f-5983dd4bedbd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:01.459213 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8b686078-70fe-43c3-b74f-5983dd4bedbd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Going to try to stop instance {{(pid=117695) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 17:13:01.489617 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-daf6fd8e-c214-4acc-aeae-74f60a82d399 req-49282d0b-47a9-42c2-a01a-bc4fcc106b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "475dd99c-12d2-41dc-8a56-c090ad97daa9", "tag": "7edb7e9c-d195-4fd0-ac49-cecab1f2db8b"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:01.509767 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-daf6fd8e-c214-4acc-aeae-74f60a82d399 req-49282d0b-47a9-42c2-a01a-bc4fcc106b80 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:01.510019 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8b686078-70fe-43c3-b74f-5983dd4bedbd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/action" status: 202 len: 0 microversion: 2.1 time: 0.084654 May 25 17:13:01.510222 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-daf6fd8e-c214-4acc-aeae-74f60a82d399 req-49282d0b-47a9-42c2-a01a-bc4fcc106b80 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:01.510514 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 255/491] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:13:01 2022] POST /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:13:01.519793 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-fc773f55-2db6-4603-9fbc-b6a0e3fa4dae tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:01.521016 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-fc773f55-2db6-4603-9fbc-b6a0e3fa4dae tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:01.523318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-daf6fd8e-c214-4acc-aeae-74f60a82d399 req-49282d0b-47a9-42c2-a01a-bc4fcc106b80 service nova] Creating event network-changed:7edb7e9c-d195-4fd0-ac49-cecab1f2db8b for instance 475dd99c-12d2-41dc-8a56-c090ad97daa9 on hv-cinder-84330 May 25 17:13:01.527832 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fc773f55-2db6-4603-9fbc-b6a0e3fa4dae tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:01.528384 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fc773f55-2db6-4603-9fbc-b6a0e3fa4dae tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:01.528723 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-daf6fd8e-c214-4acc-aeae-74f60a82d399 req-49282d0b-47a9-42c2-a01a-bc4fcc106b80 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044120 May 25 17:13:01.529194 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fc773f55-2db6-4603-9fbc-b6a0e3fa4dae tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:01.529674 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 237/492] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:13:01.529946 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fc773f55-2db6-4603-9fbc-b6a0e3fa4dae tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:01.665838 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-fc773f55-2db6-4603-9fbc-b6a0e3fa4dae tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:01.674701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-fc773f55-2db6-4603-9fbc-b6a0e3fa4dae tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.159135 May 25 17:13:01.675271 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 256/493] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:01 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:01.849295 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a4055c5d-90ec-492f-bfed-857abb5315cf tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:01.849992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a4055c5d-90ec-492f-bfed-857abb5315cf tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:01.857174 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4055c5d-90ec-492f-bfed-857abb5315cf tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:01.857629 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4055c5d-90ec-492f-bfed-857abb5315cf tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:01.858405 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4055c5d-90ec-492f-bfed-857abb5315cf tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:01.858846 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4055c5d-90ec-492f-bfed-857abb5315cf tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:02.036940 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a4055c5d-90ec-492f-bfed-857abb5315cf tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:02.045088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a4055c5d-90ec-492f-bfed-857abb5315cf tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.199854 May 25 17:13:02.045658 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 238/494] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:01 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:02.440836 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6c7eedaa-59cb-4b0d-9732-db8d53f32d56 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:02.441356 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6c7eedaa-59cb-4b0d-9732-db8d53f32d56 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:02.447884 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6c7eedaa-59cb-4b0d-9732-db8d53f32d56 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:02.449132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6c7eedaa-59cb-4b0d-9732-db8d53f32d56 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:02.449913 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6c7eedaa-59cb-4b0d-9732-db8d53f32d56 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:02.450357 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6c7eedaa-59cb-4b0d-9732-db8d53f32d56 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:02.580234 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6c7eedaa-59cb-4b0d-9732-db8d53f32d56 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:02.587606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6c7eedaa-59cb-4b0d-9732-db8d53f32d56 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1318 microversion: 2.1 time: 0.150987 May 25 17:13:02.588175 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 257/495] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:02 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:02.692753 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e8ddf1d5-fc3b-4cf5-9c2e-bc7392427b7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:02.693305 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e8ddf1d5-fc3b-4cf5-9c2e-bc7392427b7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:02.700341 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8ddf1d5-fc3b-4cf5-9c2e-bc7392427b7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:02.700888 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8ddf1d5-fc3b-4cf5-9c2e-bc7392427b7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:02.701659 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8ddf1d5-fc3b-4cf5-9c2e-bc7392427b7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:02.702098 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8ddf1d5-fc3b-4cf5-9c2e-bc7392427b7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:02.828120 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e8ddf1d5-fc3b-4cf5-9c2e-bc7392427b7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:02.835481 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e8ddf1d5-fc3b-4cf5-9c2e-bc7392427b7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.146632 May 25 17:13:02.836041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 239/496] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:02 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:03.063361 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-92131616-f519-41ac-9be6-ab21a1dc4814 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:03.064009 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-92131616-f519-41ac-9be6-ab21a1dc4814 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:03.070409 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92131616-f519-41ac-9be6-ab21a1dc4814 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:03.070908 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92131616-f519-41ac-9be6-ab21a1dc4814 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:03.071707 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92131616-f519-41ac-9be6-ab21a1dc4814 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:03.072151 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92131616-f519-41ac-9be6-ab21a1dc4814 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:03.422229 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-92131616-f519-41ac-9be6-ab21a1dc4814 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:03.430164 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-92131616-f519-41ac-9be6-ab21a1dc4814 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.370938 May 25 17:13:03.430728 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 258/497] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:03 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:03.605278 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2eb73adb-a384-4f52-8d05-f0475975a01f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:03.606192 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2eb73adb-a384-4f52-8d05-f0475975a01f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:03.612991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2eb73adb-a384-4f52-8d05-f0475975a01f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:03.613452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2eb73adb-a384-4f52-8d05-f0475975a01f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:03.614232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2eb73adb-a384-4f52-8d05-f0475975a01f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:03.614678 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2eb73adb-a384-4f52-8d05-f0475975a01f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:03.830202 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2eb73adb-a384-4f52-8d05-f0475975a01f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:03.838218 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2eb73adb-a384-4f52-8d05-f0475975a01f tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1318 microversion: 2.1 time: 0.237391 May 25 17:13:03.838777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 240/498] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:03 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:03.852908 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c2678f18-763c-40f3-b756-e9bc99cc9e9d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:03.853571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c2678f18-763c-40f3-b756-e9bc99cc9e9d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:03.861622 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c2678f18-763c-40f3-b756-e9bc99cc9e9d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:03.862340 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c2678f18-763c-40f3-b756-e9bc99cc9e9d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:03.863291 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c2678f18-763c-40f3-b756-e9bc99cc9e9d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:03.864497 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c2678f18-763c-40f3-b756-e9bc99cc9e9d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:03.999999 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c2678f18-763c-40f3-b756-e9bc99cc9e9d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:04.007658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c2678f18-763c-40f3-b756-e9bc99cc9e9d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.158587 May 25 17:13:04.008231 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 259/499] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:03 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:04.447490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-04abb4c1-bfd1-4486-87a7-abb49e06b984 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:04.448123 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-04abb4c1-bfd1-4486-87a7-abb49e06b984 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:04.454818 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04abb4c1-bfd1-4486-87a7-abb49e06b984 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:04.455276 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04abb4c1-bfd1-4486-87a7-abb49e06b984 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:04.456041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04abb4c1-bfd1-4486-87a7-abb49e06b984 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:04.456480 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04abb4c1-bfd1-4486-87a7-abb49e06b984 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:04.812529 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-04abb4c1-bfd1-4486-87a7-abb49e06b984 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:04.820531 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-04abb4c1-bfd1-4486-87a7-abb49e06b984 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.376935 May 25 17:13:04.821124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 241/500] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:04 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:04.856330 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d204561b-b8da-4976-bf29-5b0920382dfa tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:04.856970 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d204561b-b8da-4976-bf29-5b0920382dfa tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:04.863386 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d204561b-b8da-4976-bf29-5b0920382dfa tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:04.863837 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d204561b-b8da-4976-bf29-5b0920382dfa tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:04.864598 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d204561b-b8da-4976-bf29-5b0920382dfa tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:04.865067 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d204561b-b8da-4976-bf29-5b0920382dfa tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:04.995070 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d204561b-b8da-4976-bf29-5b0920382dfa tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:05.002406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d204561b-b8da-4976-bf29-5b0920382dfa tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1318 microversion: 2.1 time: 0.151095 May 25 17:13:05.002961 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 260/501] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:04 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:05.023538 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8573609a-abbb-4fce-9cf3-4f2aa6611b58 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:05.024152 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8573609a-abbb-4fce-9cf3-4f2aa6611b58 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:05.030861 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8573609a-abbb-4fce-9cf3-4f2aa6611b58 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.031318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8573609a-abbb-4fce-9cf3-4f2aa6611b58 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.032083 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8573609a-abbb-4fce-9cf3-4f2aa6611b58 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.032525 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8573609a-abbb-4fce-9cf3-4f2aa6611b58 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.036571 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:05.062721 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-cc2dcbd3-07a7-490a-bcd2-c7f27ab80214 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:05.063212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-cc2dcbd3-07a7-490a-bcd2-c7f27ab80214 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:05.069220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cc2dcbd3-07a7-490a-bcd2-c7f27ab80214 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.069672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cc2dcbd3-07a7-490a-bcd2-c7f27ab80214 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.070438 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cc2dcbd3-07a7-490a-bcd2-c7f27ab80214 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.070877 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cc2dcbd3-07a7-490a-bcd2-c7f27ab80214 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.095780 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-cc2dcbd3-07a7-490a-bcd2-c7f27ab80214 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b/ips" status: 200 len: 149 microversion: 2.1 time: 0.037835 May 25 17:13:05.096360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 261/502] 10.222.0.31 () {58 vars in 1247 bytes} [Wed May 25 17:13:05 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:13:05.107682 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b6bf6a4b-f6e8-42c6-b1d6-d92a43354c9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce29024b-cc73-42a2-8ac1-90a4d8e82291"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:05.108868 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b6bf6a4b-f6e8-42c6-b1d6-d92a43354c9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:05.114833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b6bf6a4b-f6e8-42c6-b1d6-d92a43354c9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.115291 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b6bf6a4b-f6e8-42c6-b1d6-d92a43354c9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.116060 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b6bf6a4b-f6e8-42c6-b1d6-d92a43354c9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.116493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b6bf6a4b-f6e8-42c6-b1d6-d92a43354c9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.178832 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8573609a-abbb-4fce-9cf3-4f2aa6611b58 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:05.186688 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8573609a-abbb-4fce-9cf3-4f2aa6611b58 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.166925 May 25 17:13:05.187622 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 242/503] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:05 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:05.197209 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-b6bf6a4b-f6e8-42c6-b1d6-d92a43354c9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Invalid volume: volume ce29024b-cc73-42a2-8ac1-90a4d8e82291 is already attached to instances: 4176ef9b-9601-4e3d-bc52-51854be03fd7 May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b6bf6a4b-f6e8-42c6-b1d6-d92a43354c9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: POST /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b/os-volume_attachments HTTP/1.1 May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 74 May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:13:05.199516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {"volumeAttachment": {"volumeId": "ce29024b-cc73-42a2-8ac1-90a4d8e82291"}} May 25 17:13:05.200997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Invalid volume: volume ce29024b-cc73-42a2-8ac1-90a4d8e82291 is already attached to instances: 4176ef9b-9601-4e3d-bc52-51854be03fd7 May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'server_id': '145de36f-e49b-4444-85c5-4a207d31619b', 'body': {'volumeAttachment': {'volumeId': 'ce29024b-cc73-42a2-8ac1-90a4d8e82291'}}} May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce29024b-cc73-42a2-8ac1-90a4d8e82291 is already attached to instances: 4176ef9b-9601-4e3d-bc52-51854be03fd7 May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:05.201803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce29024b-cc73-42a2-8ac1-90a4d8e82291 is already attached to instances: 4176ef9b-9601-4e3d-bc52-51854be03fd7 May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:05.202865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:05.203979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:05.203979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:13:05.203979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:13:05.203979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce29024b-cc73-42a2-8ac1-90a4d8e82291 is already attached to instances: 4176ef9b-9601-4e3d-bc52-51854be03fd7 May 25 17:13:05.203979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:05.203979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b6bf6a4b-f6e8-42c6-b1d6-d92a43354c9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 400 to user: Invalid volume: volume ce29024b-cc73-42a2-8ac1-90a4d8e82291 is already attached to instances: 4176ef9b-9601-4e3d-bc52-51854be03fd7 {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:13:05.203979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b6bf6a4b-f6e8-42c6-b1d6-d92a43354c9b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098287 May 25 17:13:05.203979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 262/504] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:13:05 2022] POST /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 25 17:13:05.209759 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-18cdb60f-9e90-47bf-96e1-b656324a07e3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:05.210256 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-18cdb60f-9e90-47bf-96e1-b656324a07e3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:05.216355 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18cdb60f-9e90-47bf-96e1-b656324a07e3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.216848 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18cdb60f-9e90-47bf-96e1-b656324a07e3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.217613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18cdb60f-9e90-47bf-96e1-b656324a07e3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.218057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-18cdb60f-9e90-47bf-96e1-b656324a07e3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.242710 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-18cdb60f-9e90-47bf-96e1-b656324a07e3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:13:05.316153 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-18cdb60f-9e90-47bf-96e1-b656324a07e3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 204 len: 0 microversion: 2.1 time: 0.109815 May 25 17:13:05.316770 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 243/505] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:13:05 2022] DELETE /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:13:05.325896 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5c28ed57-58c9-479d-81ed-53463e129d79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:05.326124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5c28ed57-58c9-479d-81ed-53463e129d79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:05.332575 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c28ed57-58c9-479d-81ed-53463e129d79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.333095 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c28ed57-58c9-479d-81ed-53463e129d79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.333859 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c28ed57-58c9-479d-81ed-53463e129d79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.334298 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c28ed57-58c9-479d-81ed-53463e129d79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.352334 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:05.462876 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5c28ed57-58c9-479d-81ed-53463e129d79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:05.470847 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5c28ed57-58c9-479d-81ed-53463e129d79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1680 microversion: 2.1 time: 0.149789 May 25 17:13:05.471396 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 263/506] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:05 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:05.838715 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a7fdab17-a45a-44bd-b613-fa06bb3deb68 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:05.839717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a7fdab17-a45a-44bd-b613-fa06bb3deb68 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:05.846225 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a7fdab17-a45a-44bd-b613-fa06bb3deb68 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.846677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a7fdab17-a45a-44bd-b613-fa06bb3deb68 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.847467 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a7fdab17-a45a-44bd-b613-fa06bb3deb68 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:05.847877 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a7fdab17-a45a-44bd-b613-fa06bb3deb68 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:05.981116 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a7fdab17-a45a-44bd-b613-fa06bb3deb68 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:05.992812 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a7fdab17-a45a-44bd-b613-fa06bb3deb68 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.158350 May 25 17:13:05.993375 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 244/507] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:05 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:06.019132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-80057dc0-0eb2-48ac-8642-a676fae02130 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:06.019769 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-80057dc0-0eb2-48ac-8642-a676fae02130 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:06.026144 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-80057dc0-0eb2-48ac-8642-a676fae02130 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:06.027337 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-80057dc0-0eb2-48ac-8642-a676fae02130 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:06.028094 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-80057dc0-0eb2-48ac-8642-a676fae02130 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:06.028528 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-80057dc0-0eb2-48ac-8642-a676fae02130 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:06.157848 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-80057dc0-0eb2-48ac-8642-a676fae02130 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:06.165211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-80057dc0-0eb2-48ac-8642-a676fae02130 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1318 microversion: 2.1 time: 0.149871 May 25 17:13:06.165768 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 264/508] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:06 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:06.204431 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f011a477-9478-4406-939d-b7d876ead1c8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:06.204989 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f011a477-9478-4406-939d-b7d876ead1c8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:06.211076 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f011a477-9478-4406-939d-b7d876ead1c8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:06.211526 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f011a477-9478-4406-939d-b7d876ead1c8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:06.212289 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f011a477-9478-4406-939d-b7d876ead1c8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:06.212762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f011a477-9478-4406-939d-b7d876ead1c8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:06.345061 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f011a477-9478-4406-939d-b7d876ead1c8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:06.352671 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f011a477-9478-4406-939d-b7d876ead1c8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.152157 May 25 17:13:06.353299 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 245/509] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:06 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:06.490073 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-07699ab3-ecda-49c5-bb64-7a9b06d535c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:06.490593 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-07699ab3-ecda-49c5-bb64-7a9b06d535c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:06.497229 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07699ab3-ecda-49c5-bb64-7a9b06d535c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:06.497670 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07699ab3-ecda-49c5-bb64-7a9b06d535c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:06.498430 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07699ab3-ecda-49c5-bb64-7a9b06d535c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:06.498860 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07699ab3-ecda-49c5-bb64-7a9b06d535c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:06.628167 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-07699ab3-ecda-49c5-bb64-7a9b06d535c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:06.635538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-07699ab3-ecda-49c5-bb64-7a9b06d535c5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1680 microversion: 2.1 time: 0.149542 May 25 17:13:06.636404 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 265/510] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:06 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:07.010600 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a6f67420-8856-4b7f-ae49-52c5ff4cbcad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:07.011495 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a6f67420-8856-4b7f-ae49-52c5ff4cbcad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:07.018142 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6f67420-8856-4b7f-ae49-52c5ff4cbcad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:07.018613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6f67420-8856-4b7f-ae49-52c5ff4cbcad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:07.019492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6f67420-8856-4b7f-ae49-52c5ff4cbcad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:07.019924 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6f67420-8856-4b7f-ae49-52c5ff4cbcad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:07.183281 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-eaa354da-df1b-4f27-9c04-0d78a24ade57 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:07.184193 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-eaa354da-df1b-4f27-9c04-0d78a24ade57 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:07.192134 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eaa354da-df1b-4f27-9c04-0d78a24ade57 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:07.192591 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eaa354da-df1b-4f27-9c04-0d78a24ade57 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:07.193399 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eaa354da-df1b-4f27-9c04-0d78a24ade57 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:07.194028 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eaa354da-df1b-4f27-9c04-0d78a24ade57 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:07.254089 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a6f67420-8856-4b7f-ae49-52c5ff4cbcad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:07.263961 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a6f67420-8856-4b7f-ae49-52c5ff4cbcad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.256407 May 25 17:13:07.265587 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 246/511] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:07 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:07.349182 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-eaa354da-df1b-4f27-9c04-0d78a24ade57 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:07.357370 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-eaa354da-df1b-4f27-9c04-0d78a24ade57 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1318 microversion: 2.1 time: 0.178566 May 25 17:13:07.357950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 266/512] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:07 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:07.374213 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ba7ef2c1-0f86-42f0-ad2a-6b2e60518dd8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:07.375089 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ba7ef2c1-0f86-42f0-ad2a-6b2e60518dd8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:07.381792 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba7ef2c1-0f86-42f0-ad2a-6b2e60518dd8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:07.382345 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba7ef2c1-0f86-42f0-ad2a-6b2e60518dd8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:07.383113 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba7ef2c1-0f86-42f0-ad2a-6b2e60518dd8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:07.383734 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba7ef2c1-0f86-42f0-ad2a-6b2e60518dd8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:07.655692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f9520f3e-c107-4216-a6a8-62828b04ac76 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:07.656479 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f9520f3e-c107-4216-a6a8-62828b04ac76 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:07.664297 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f9520f3e-c107-4216-a6a8-62828b04ac76 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:07.664781 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f9520f3e-c107-4216-a6a8-62828b04ac76 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:07.665608 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f9520f3e-c107-4216-a6a8-62828b04ac76 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:07.666036 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f9520f3e-c107-4216-a6a8-62828b04ac76 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:07.698009 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ba7ef2c1-0f86-42f0-ad2a-6b2e60518dd8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:07.706509 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ba7ef2c1-0f86-42f0-ad2a-6b2e60518dd8 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.338616 May 25 17:13:07.707705 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 247/513] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:07 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:07.728611 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:07.748078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=6 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:07.877763 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f9520f3e-c107-4216-a6a8-62828b04ac76 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:07.878587 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-93e1ac97-8b40-47af-91b8-6972be350075 req-97a08f1d-7e96-4576-93f1-004c7775231e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475dd99c-12d2-41dc-8a56-c090ad97daa9", "name": "network-vif-plugged", "status": "completed", "tag": "7edb7e9c-d195-4fd0-ac49-cecab1f2db8b"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:07.884193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:07.887263 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f9520f3e-c107-4216-a6a8-62828b04ac76 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1680 microversion: 2.1 time: 0.235627 May 25 17:13:07.888412 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 267/514] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:07 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1680 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:07.890319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-93e1ac97-8b40-47af-91b8-6972be350075 req-97a08f1d-7e96-4576-93f1-004c7775231e service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:07.890973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-93e1ac97-8b40-47af-91b8-6972be350075 req-97a08f1d-7e96-4576-93f1-004c7775231e service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:07.905170 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-93e1ac97-8b40-47af-91b8-6972be350075 req-97a08f1d-7e96-4576-93f1-004c7775231e service nova] Creating event network-vif-plugged:7edb7e9c-d195-4fd0-ac49-cecab1f2db8b for instance 475dd99c-12d2-41dc-8a56-c090ad97daa9 on hv-cinder-84330 May 25 17:13:07.911089 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-93e1ac97-8b40-47af-91b8-6972be350075 req-97a08f1d-7e96-4576-93f1-004c7775231e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038347 May 25 17:13:07.911818 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 248/515] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:13:08.288728 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-c0fd74a4-4d68-4694-9444-ffde96325553 req-89ef5ff3-2a19-4388-94f0-2e74350bc89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145de36f-e49b-4444-85c5-4a207d31619b", "name": "network-vif-deleted", "tag": "59d8b30c-3e18-47c8-ad7a-a6090706a8e6"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:08.289598 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1558809c-b7da-4f4b-9d48-592a3e983704 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:08.290848 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1558809c-b7da-4f4b-9d48-592a3e983704 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:08.297997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1558809c-b7da-4f4b-9d48-592a3e983704 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:08.298752 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1558809c-b7da-4f4b-9d48-592a3e983704 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:08.299762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1558809c-b7da-4f4b-9d48-592a3e983704 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:08.300420 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1558809c-b7da-4f4b-9d48-592a3e983704 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:08.302343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-c0fd74a4-4d68-4694-9444-ffde96325553 req-89ef5ff3-2a19-4388-94f0-2e74350bc89d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:08.303550 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-c0fd74a4-4d68-4694-9444-ffde96325553 req-89ef5ff3-2a19-4388-94f0-2e74350bc89d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:08.320237 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-c0fd74a4-4d68-4694-9444-ffde96325553 req-89ef5ff3-2a19-4388-94f0-2e74350bc89d service nova] Creating event network-vif-deleted:59d8b30c-3e18-47c8-ad7a-a6090706a8e6 for instance 145de36f-e49b-4444-85c5-4a207d31619b on hv-cinder-84330 May 25 17:13:08.327188 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-c0fd74a4-4d68-4694-9444-ffde96325553 req-89ef5ff3-2a19-4388-94f0-2e74350bc89d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042910 May 25 17:13:08.328428 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 249/516] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:08.377216 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2860d518-f592-4a6a-9928-2ab9f0facae3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:08.378783 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2860d518-f592-4a6a-9928-2ab9f0facae3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:08.386641 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2860d518-f592-4a6a-9928-2ab9f0facae3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:08.387332 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2860d518-f592-4a6a-9928-2ab9f0facae3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:08.388252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2860d518-f592-4a6a-9928-2ab9f0facae3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:08.388877 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2860d518-f592-4a6a-9928-2ab9f0facae3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:08.453008 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1558809c-b7da-4f4b-9d48-592a3e983704 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:08.461638 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1558809c-b7da-4f4b-9d48-592a3e983704 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.182459 May 25 17:13:08.462548 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 268/517] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:08 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:08.547255 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2860d518-f592-4a6a-9928-2ab9f0facae3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:08.555615 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2860d518-f592-4a6a-9928-2ab9f0facae3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1318 microversion: 2.1 time: 0.182944 May 25 17:13:08.556186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 250/518] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:08 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:08.725681 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-44d22fb0-a430-4090-b4cc-ea76764eb502 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:08.726733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-44d22fb0-a430-4090-b4cc-ea76764eb502 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:08.735168 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44d22fb0-a430-4090-b4cc-ea76764eb502 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:08.735638 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44d22fb0-a430-4090-b4cc-ea76764eb502 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:08.736975 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44d22fb0-a430-4090-b4cc-ea76764eb502 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:08.737732 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-44d22fb0-a430-4090-b4cc-ea76764eb502 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:08.877654 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-44d22fb0-a430-4090-b4cc-ea76764eb502 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:08.886604 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-44d22fb0-a430-4090-b4cc-ea76764eb502 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.165252 May 25 17:13:08.889033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 269/519] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:08 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:08.904915 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:08.905619 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:08.911765 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:08.912297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:08.913183 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:08.913686 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:08.945660 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:08.946026 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:08.946478 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lazy-loading 'fault' on Instance uuid 145de36f-e49b-4444-85c5-4a207d31619b {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:13:08.989464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:08.997447 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-05f1b912-aa21-41b5-af6d-5f656124aa29 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 200 len: 1331 microversion: 2.1 time: 0.096335 May 25 17:13:08.998127 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 251/520] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:08 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:09.480203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a171717d-0668-45a4-91fa-b0a72c5c4cc0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:09.481220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a171717d-0668-45a4-91fa-b0a72c5c4cc0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:09.487396 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a171717d-0668-45a4-91fa-b0a72c5c4cc0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:09.487845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a171717d-0668-45a4-91fa-b0a72c5c4cc0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:09.488653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a171717d-0668-45a4-91fa-b0a72c5c4cc0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:09.489116 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a171717d-0668-45a4-91fa-b0a72c5c4cc0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:09.574757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8304151f-cfad-41c3-ad96-41916cff7108 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:09.576023 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8304151f-cfad-41c3-ad96-41916cff7108 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:09.583480 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8304151f-cfad-41c3-ad96-41916cff7108 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:09.584146 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8304151f-cfad-41c3-ad96-41916cff7108 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:09.585112 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8304151f-cfad-41c3-ad96-41916cff7108 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:09.585869 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8304151f-cfad-41c3-ad96-41916cff7108 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:09.628220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a171717d-0668-45a4-91fa-b0a72c5c4cc0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:09.637185 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a171717d-0668-45a4-91fa-b0a72c5c4cc0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.161620 May 25 17:13:09.637819 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 270/521] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:09 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:09.734130 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8304151f-cfad-41c3-ad96-41916cff7108 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:09.741645 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8304151f-cfad-41c3-ad96-41916cff7108 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1318 microversion: 2.1 time: 0.171659 May 25 17:13:09.742211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 252/522] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:09 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:09.904022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-76fec3c3-55c9-4520-97be-ed8d955dc6d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:09.904633 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-76fec3c3-55c9-4520-97be-ed8d955dc6d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:09.911182 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76fec3c3-55c9-4520-97be-ed8d955dc6d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:09.911634 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76fec3c3-55c9-4520-97be-ed8d955dc6d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:09.912392 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76fec3c3-55c9-4520-97be-ed8d955dc6d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:09.912854 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76fec3c3-55c9-4520-97be-ed8d955dc6d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:10.015887 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-83ecc28f-6a5a-480c-9d2f-8dd786af408c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:10.017167 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-83ecc28f-6a5a-480c-9d2f-8dd786af408c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:10.023663 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83ecc28f-6a5a-480c-9d2f-8dd786af408c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:10.024111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83ecc28f-6a5a-480c-9d2f-8dd786af408c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:10.024917 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83ecc28f-6a5a-480c-9d2f-8dd786af408c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:10.025579 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83ecc28f-6a5a-480c-9d2f-8dd786af408c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:10.041435 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-83ecc28f-6a5a-480c-9d2f-8dd786af408c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-83ecc28f-6a5a-480c-9d2f-8dd786af408c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b HTTP/1.1 May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:13:10.044606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:13:10.045939 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '145de36f-e49b-4444-85c5-4a207d31619b'} May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:13:10.046670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:13:10.047864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:13:10.048941 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-83ecc28f-6a5a-480c-9d2f-8dd786af408c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:13:10.048941 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-83ecc28f-6a5a-480c-9d2f-8dd786af408c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 404 len: 111 microversion: 2.1 time: 0.034609 May 25 17:13:10.048941 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 253/523] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:10 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:13:10.055120 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c9718464-83b6-4ca8-ac91-e2423de9a1d7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '.version_select at 0x7f3d4e9bbe50>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:10.056839 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-76fec3c3-55c9-4520-97be-ed8d955dc6d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:10.067018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-76fec3c3-55c9-4520-97be-ed8d955dc6d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.167483 May 25 17:13:10.076553 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 271/524] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:09 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:10.079813 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c9718464-83b6-4ca8-ac91-e2423de9a1d7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064814291" status: 202 len: 0 microversion: 2.1 time: 0.028287 May 25 17:13:10.080388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 254/525] 10.222.0.31 () {58 vars in 1220 bytes} [Wed May 25 17:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064814291 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 17:13:10.663407 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2fdbeb87-db03-4adc-8d18-70abe00acdcc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:10.664025 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2fdbeb87-db03-4adc-8d18-70abe00acdcc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:10.671129 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2fdbeb87-db03-4adc-8d18-70abe00acdcc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:10.672072 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2fdbeb87-db03-4adc-8d18-70abe00acdcc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:10.673085 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2fdbeb87-db03-4adc-8d18-70abe00acdcc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:10.673673 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2fdbeb87-db03-4adc-8d18-70abe00acdcc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:10.759511 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7b306c6e-1e53-49de-a629-a46daa8a85c6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:10.760968 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7b306c6e-1e53-49de-a629-a46daa8a85c6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:10.770804 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b306c6e-1e53-49de-a629-a46daa8a85c6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:10.771367 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b306c6e-1e53-49de-a629-a46daa8a85c6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:10.772413 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b306c6e-1e53-49de-a629-a46daa8a85c6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:10.773119 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b306c6e-1e53-49de-a629-a46daa8a85c6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:10.830664 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2fdbeb87-db03-4adc-8d18-70abe00acdcc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:10.840242 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2fdbeb87-db03-4adc-8d18-70abe00acdcc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.188932 May 25 17:13:10.840862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 272/526] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:10 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:10.847120 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-247cbeb6-e84c-470e-b319-5c51b7451b52 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:10.848850 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-247cbeb6-e84c-470e-b319-5c51b7451b52 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:10.857820 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-247cbeb6-e84c-470e-b319-5c51b7451b52 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:10.858288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-247cbeb6-e84c-470e-b319-5c51b7451b52 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:10.859176 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-247cbeb6-e84c-470e-b319-5c51b7451b52 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:10.859756 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-247cbeb6-e84c-470e-b319-5c51b7451b52 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:10.924473 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7b306c6e-1e53-49de-a629-a46daa8a85c6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:10.931938 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7b306c6e-1e53-49de-a629-a46daa8a85c6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1507 microversion: 2.1 time: 0.176313 May 25 17:13:10.932576 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 255/527] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:10 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:10.943902 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-247cbeb6-e84c-470e-b319-5c51b7451b52 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lazy-loading 'services' on Instance uuid 4176ef9b-9601-4e3d-bc52-51854be03fd7 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:13:10.949685 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a4f2aebc-98fa-4e59-878d-6054a1a65747 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f9180be-9564-4a4e-a602-4c3a086191ca", "device": "/dev/sdb"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:10.951268 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a4f2aebc-98fa-4e59-878d-6054a1a65747 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:10.957304 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4f2aebc-98fa-4e59-878d-6054a1a65747 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:10.957759 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4f2aebc-98fa-4e59-878d-6054a1a65747 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:10.958533 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4f2aebc-98fa-4e59-878d-6054a1a65747 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:10.958971 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4f2aebc-98fa-4e59-878d-6054a1a65747 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:11.023585 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-247cbeb6-e84c-470e-b319-5c51b7451b52 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/os-volume_attachments/ce29024b-cc73-42a2-8ac1-90a4d8e82291" status: 202 len: 0 microversion: 2.1 time: 0.180791 May 25 17:13:11.024592 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 273/528] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:13:10 2022] DELETE /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/os-volume_attachments/ce29024b-cc73-42a2-8ac1-90a4d8e82291 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:13:11.033576 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d9527ec9-3a31-4279-95d5-b12a58e8a8d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:11.034896 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d9527ec9-3a31-4279-95d5-b12a58e8a8d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:11.042671 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d9527ec9-3a31-4279-95d5-b12a58e8a8d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:11.043474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d9527ec9-3a31-4279-95d5-b12a58e8a8d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:11.044401 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d9527ec9-3a31-4279-95d5-b12a58e8a8d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:11.044974 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d9527ec9-3a31-4279-95d5-b12a58e8a8d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:11.077272 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d9527ec9-3a31-4279-95d5-b12a58e8a8d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048029 May 25 17:13:11.078212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 274/529] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:13:11 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:13:11.090325 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-fd38979f-35f6-4b54-adf1-014204b63dcf tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:11.090934 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-fd38979f-35f6-4b54-adf1-014204b63dcf tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:11.097160 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fd38979f-35f6-4b54-adf1-014204b63dcf tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:11.097612 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fd38979f-35f6-4b54-adf1-014204b63dcf tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:11.098490 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fd38979f-35f6-4b54-adf1-014204b63dcf tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:11.098801 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fd38979f-35f6-4b54-adf1-014204b63dcf tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:11.256878 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-fd38979f-35f6-4b54-adf1-014204b63dcf tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:11.262612 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a4f2aebc-98fa-4e59-878d-6054a1a65747 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "POST /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317661 May 25 17:13:11.263252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 256/530] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:13:10 2022] POST /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:13:11.265118 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-fd38979f-35f6-4b54-adf1-014204b63dcf tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.184181 May 25 17:13:11.268716 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 275/531] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:11 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:11.857882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6bc2b332-e3eb-4203-a94d-e7db28efdf72 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:11.858617 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6bc2b332-e3eb-4203-a94d-e7db28efdf72 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:11.865232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6bc2b332-e3eb-4203-a94d-e7db28efdf72 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:11.865687 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6bc2b332-e3eb-4203-a94d-e7db28efdf72 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:11.866486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6bc2b332-e3eb-4203-a94d-e7db28efdf72 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:11.866945 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6bc2b332-e3eb-4203-a94d-e7db28efdf72 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:11.993533 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6bc2b332-e3eb-4203-a94d-e7db28efdf72 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:12.001961 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6bc2b332-e3eb-4203-a94d-e7db28efdf72 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.149075 May 25 17:13:12.002537 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 257/532] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:11 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:12.090320 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-06dc782e-d8eb-46a4-a970-46538e2be864 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:12.091277 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-06dc782e-d8eb-46a4-a970-46538e2be864 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:12.097866 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06dc782e-d8eb-46a4-a970-46538e2be864 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:12.098319 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06dc782e-d8eb-46a4-a970-46538e2be864 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:12.099087 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06dc782e-d8eb-46a4-a970-46538e2be864 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:12.099550 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-06dc782e-d8eb-46a4-a970-46538e2be864 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:12.132022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-06dc782e-d8eb-46a4-a970-46538e2be864 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046769 May 25 17:13:12.132737 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 276/533] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:13:12 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 17:13:12.191467 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-487c4467-cb1b-48ca-b7b1-832b57b0ead3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:12.191963 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-487c4467-cb1b-48ca-b7b1-832b57b0ead3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:12.199236 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-487c4467-cb1b-48ca-b7b1-832b57b0ead3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:12.199687 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-487c4467-cb1b-48ca-b7b1-832b57b0ead3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:12.200484 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-487c4467-cb1b-48ca-b7b1-832b57b0ead3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:12.200999 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-487c4467-cb1b-48ca-b7b1-832b57b0ead3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:12.218786 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:12.229485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-487c4467-cb1b-48ca-b7b1-832b57b0ead3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:13:12.282101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-76093c69-9c02-469a-8e96-39ce535fb18f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:12.282911 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-76093c69-9c02-469a-8e96-39ce535fb18f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:12.290499 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76093c69-9c02-469a-8e96-39ce535fb18f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:12.290959 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76093c69-9c02-469a-8e96-39ce535fb18f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:12.291768 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76093c69-9c02-469a-8e96-39ce535fb18f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:12.292408 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76093c69-9c02-469a-8e96-39ce535fb18f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:12.309529 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-487c4467-cb1b-48ca-b7b1-832b57b0ead3 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 204 len: 0 microversion: 2.1 time: 0.121611 May 25 17:13:12.310451 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 258/534] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:13:12 2022] DELETE /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:13:12.320006 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b144882b-f8bb-415b-8315-b53e822a5098 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:12.321004 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b144882b-f8bb-415b-8315-b53e822a5098 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:12.332108 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b144882b-f8bb-415b-8315-b53e822a5098 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:12.332560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b144882b-f8bb-415b-8315-b53e822a5098 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:12.333390 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b144882b-f8bb-415b-8315-b53e822a5098 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:12.333823 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b144882b-f8bb-415b-8315-b53e822a5098 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:12.439264 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-76093c69-9c02-469a-8e96-39ce535fb18f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:12.447315 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-76093c69-9c02-469a-8e96-39ce535fb18f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.168987 May 25 17:13:12.448084 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 277/535] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:12 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:12.478100 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b144882b-f8bb-415b-8315-b53e822a5098 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:12.486319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b144882b-f8bb-415b-8315-b53e822a5098 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1682 microversion: 2.1 time: 0.171237 May 25 17:13:12.486918 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 259/536] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:12 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:13.019667 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-be720872-4d53-4246-88f7-b1666b82f791 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:13.020203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-be720872-4d53-4246-88f7-b1666b82f791 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:13.026834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be720872-4d53-4246-88f7-b1666b82f791 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:13.027267 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be720872-4d53-4246-88f7-b1666b82f791 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:13.028035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be720872-4d53-4246-88f7-b1666b82f791 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:13.028476 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-be720872-4d53-4246-88f7-b1666b82f791 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:13.154953 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-be720872-4d53-4246-88f7-b1666b82f791 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:13.162808 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-be720872-4d53-4246-88f7-b1666b82f791 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.147160 May 25 17:13:13.163370 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 278/537] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:13 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:13.465547 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3ee99abc-2262-4fcd-8aa5-31cb3a42bc10 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:13.466175 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3ee99abc-2262-4fcd-8aa5-31cb3a42bc10 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:13.472625 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ee99abc-2262-4fcd-8aa5-31cb3a42bc10 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:13.473098 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ee99abc-2262-4fcd-8aa5-31cb3a42bc10 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:13.473848 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ee99abc-2262-4fcd-8aa5-31cb3a42bc10 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:13.474278 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ee99abc-2262-4fcd-8aa5-31cb3a42bc10 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:13.504133 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-22bbe23c-b422-4fa9-9752-a14947061cdd tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:13.504765 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-22bbe23c-b422-4fa9-9752-a14947061cdd tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:13.511625 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-22bbe23c-b422-4fa9-9752-a14947061cdd tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:13.512077 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-22bbe23c-b422-4fa9-9752-a14947061cdd tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:13.512878 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-22bbe23c-b422-4fa9-9752-a14947061cdd tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:13.513317 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-22bbe23c-b422-4fa9-9752-a14947061cdd tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:13.532983 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:13.603462 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3ee99abc-2262-4fcd-8aa5-31cb3a42bc10 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:13.611273 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3ee99abc-2262-4fcd-8aa5-31cb3a42bc10 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.150057 May 25 17:13:13.612060 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 260/538] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:13 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:13.650614 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-22bbe23c-b422-4fa9-9752-a14947061cdd tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:13.658595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-22bbe23c-b422-4fa9-9752-a14947061cdd tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1682 microversion: 2.1 time: 0.158256 May 25 17:13:13.659155 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 279/539] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:13 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:14.181164 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f75b78d3-dbc3-45ee-bfc5-bae0bb76bc57 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:14.181706 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f75b78d3-dbc3-45ee-bfc5-bae0bb76bc57 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:14.188271 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f75b78d3-dbc3-45ee-bfc5-bae0bb76bc57 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:14.188754 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f75b78d3-dbc3-45ee-bfc5-bae0bb76bc57 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:14.189531 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f75b78d3-dbc3-45ee-bfc5-bae0bb76bc57 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:14.189972 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f75b78d3-dbc3-45ee-bfc5-bae0bb76bc57 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:14.473142 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f75b78d3-dbc3-45ee-bfc5-bae0bb76bc57 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:14.482708 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f75b78d3-dbc3-45ee-bfc5-bae0bb76bc57 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.305542 May 25 17:13:14.492436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 261/540] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:14 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:14.628868 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c204118e-bca9-4d6f-8c54-2e0987330c1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:14.629479 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c204118e-bca9-4d6f-8c54-2e0987330c1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:14.631808 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:14.638909 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c204118e-bca9-4d6f-8c54-2e0987330c1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:14.639417 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c204118e-bca9-4d6f-8c54-2e0987330c1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:14.640196 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c204118e-bca9-4d6f-8c54-2e0987330c1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:14.640655 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c204118e-bca9-4d6f-8c54-2e0987330c1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:14.683815 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f2f0c749-437d-41d9-bdfd-261bb5971c1a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:14.684599 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f2f0c749-437d-41d9-bdfd-261bb5971c1a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:14.693340 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f2f0c749-437d-41d9-bdfd-261bb5971c1a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:14.694062 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f2f0c749-437d-41d9-bdfd-261bb5971c1a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:14.694988 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f2f0c749-437d-41d9-bdfd-261bb5971c1a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:14.695512 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f2f0c749-437d-41d9-bdfd-261bb5971c1a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:14.779403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c204118e-bca9-4d6f-8c54-2e0987330c1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:14.786915 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c204118e-bca9-4d6f-8c54-2e0987330c1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.161892 May 25 17:13:14.787481 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 280/541] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:14 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:15.038281 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f2f0c749-437d-41d9-bdfd-261bb5971c1a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:15.046243 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f2f0c749-437d-41d9-bdfd-261bb5971c1a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1682 microversion: 2.1 time: 0.366963 May 25 17:13:15.046821 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 262/542] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:14 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1682 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:15.500995 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1770fe58-84e8-4cde-a7d6-ca7eb7e443ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:15.501598 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1770fe58-84e8-4cde-a7d6-ca7eb7e443ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:15.507954 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1770fe58-84e8-4cde-a7d6-ca7eb7e443ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:15.508396 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1770fe58-84e8-4cde-a7d6-ca7eb7e443ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:15.509205 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1770fe58-84e8-4cde-a7d6-ca7eb7e443ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:15.509639 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1770fe58-84e8-4cde-a7d6-ca7eb7e443ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:15.684861 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1770fe58-84e8-4cde-a7d6-ca7eb7e443ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:15.693430 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1770fe58-84e8-4cde-a7d6-ca7eb7e443ad tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.196391 May 25 17:13:15.694805 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 281/543] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:15 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:15.804944 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7947ff33-7c99-4b9c-a8ed-31de04108198 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:15.805672 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7947ff33-7c99-4b9c-a8ed-31de04108198 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:15.814499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7947ff33-7c99-4b9c-a8ed-31de04108198 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:15.815019 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7947ff33-7c99-4b9c-a8ed-31de04108198 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:15.815858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7947ff33-7c99-4b9c-a8ed-31de04108198 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:15.816435 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7947ff33-7c99-4b9c-a8ed-31de04108198 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:15.823579 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-1dcd02bf-08ec-46ce-b493-fe6532fd8937 req-ba1328ea-bd70-4fee-ae3d-1f290c68ee54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4176ef9b-9601-4e3d-bc52-51854be03fd7", "name": "network-vif-deleted", "tag": "fb7d08f7-f9a7-41b7-9a81-da056a75e0de"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:15.831869 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-1dcd02bf-08ec-46ce-b493-fe6532fd8937 req-ba1328ea-bd70-4fee-ae3d-1f290c68ee54 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:15.832385 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-1dcd02bf-08ec-46ce-b493-fe6532fd8937 req-ba1328ea-bd70-4fee-ae3d-1f290c68ee54 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:15.844937 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-1dcd02bf-08ec-46ce-b493-fe6532fd8937 req-ba1328ea-bd70-4fee-ae3d-1f290c68ee54 service nova] Creating event network-vif-deleted:fb7d08f7-f9a7-41b7-9a81-da056a75e0de for instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 on hv-cinder-84330 May 25 17:13:15.849895 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-1dcd02bf-08ec-46ce-b493-fe6532fd8937 req-ba1328ea-bd70-4fee-ae3d-1f290c68ee54 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030257 May 25 17:13:15.850566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 282/544] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:15.960467 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7947ff33-7c99-4b9c-a8ed-31de04108198 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:15.969895 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7947ff33-7c99-4b9c-a8ed-31de04108198 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1676 microversion: 2.1 time: 0.168815 May 25 17:13:15.989044 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 263/545] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:15 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:16.065247 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-43406019-44a3-40bd-898b-d3f41ff95f56 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:16.066543 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-43406019-44a3-40bd-898b-d3f41ff95f56 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:16.075835 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-43406019-44a3-40bd-898b-d3f41ff95f56 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:16.076284 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-43406019-44a3-40bd-898b-d3f41ff95f56 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:16.077287 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-43406019-44a3-40bd-898b-d3f41ff95f56 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:16.077727 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-43406019-44a3-40bd-898b-d3f41ff95f56 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:16.145300 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-43406019-44a3-40bd-898b-d3f41ff95f56 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:16.154150 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-43406019-44a3-40bd-898b-d3f41ff95f56 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 200 len: 1326 microversion: 2.1 time: 0.093812 May 25 17:13:16.156993 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 283/546] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:16 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:16.711572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6040d680-ee69-40be-9ba1-b754126268ee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:16.712307 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6040d680-ee69-40be-9ba1-b754126268ee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:16.714483 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:16.719992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6040d680-ee69-40be-9ba1-b754126268ee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:16.720529 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6040d680-ee69-40be-9ba1-b754126268ee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:16.721401 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6040d680-ee69-40be-9ba1-b754126268ee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:16.721954 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6040d680-ee69-40be-9ba1-b754126268ee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:16.869039 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6040d680-ee69-40be-9ba1-b754126268ee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:16.882064 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6040d680-ee69-40be-9ba1-b754126268ee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.174351 May 25 17:13:16.882837 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 264/547] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:16 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:16.987906 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-bf5be686-39ac-43ca-b9fd-2d181d6c5cde tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:16.988439 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-bf5be686-39ac-43ca-b9fd-2d181d6c5cde tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:16.995902 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bf5be686-39ac-43ca-b9fd-2d181d6c5cde tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:16.996368 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bf5be686-39ac-43ca-b9fd-2d181d6c5cde tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:16.997161 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bf5be686-39ac-43ca-b9fd-2d181d6c5cde tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:16.997606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bf5be686-39ac-43ca-b9fd-2d181d6c5cde tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:17.127792 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-bf5be686-39ac-43ca-b9fd-2d181d6c5cde tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:17.135350 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-bf5be686-39ac-43ca-b9fd-2d181d6c5cde tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1653 microversion: 2.1 time: 0.151350 May 25 17:13:17.136488 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 284/548] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:16 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:17.152070 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b356a22e-a6eb-451a-abd4-496929d08b36 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:17.158188 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b356a22e-a6eb-451a-abd4-496929d08b36 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:17.158655 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b356a22e-a6eb-451a-abd4-496929d08b36 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:17.171634 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3803350d-d389-4b8d-8c96-41b16da1031e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:17.172358 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3803350d-d389-4b8d-8c96-41b16da1031e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:17.178470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3803350d-d389-4b8d-8c96-41b16da1031e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:17.178927 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3803350d-d389-4b8d-8c96-41b16da1031e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:17.179697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3803350d-d389-4b8d-8c96-41b16da1031e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:17.180138 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3803350d-d389-4b8d-8c96-41b16da1031e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:17.181188 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b356a22e-a6eb-451a-abd4-496929d08b36 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Going to try to start instance {{(pid=117696) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 17:13:17.194567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-3803350d-d389-4b8d-8c96-41b16da1031e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3803350d-d389-4b8d-8c96-41b16da1031e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 HTTP/1.1 May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:13:17.196200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:13:17.198467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '4176ef9b-9601-4e3d-bc52-51854be03fd7'} May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:13:17.199467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:13:17.200938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:17.202213 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3803350d-d389-4b8d-8c96-41b16da1031e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:13:17.202213 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3803350d-d389-4b8d-8c96-41b16da1031e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 404 len: 111 microversion: 2.1 time: 0.029866 May 25 17:13:17.202213 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 285/549] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:17 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:13:17.210505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-fca5e73f-a04f-4c5c-a3c6-ec510efa2c98 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '.version_select at 0x7f3d4e250ca0>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:17.228082 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b356a22e-a6eb-451a-abd4-496929d08b36 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/action" status: 202 len: 0 microversion: 2.1 time: 0.079810 May 25 17:13:17.232375 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 265/550] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:13:17 2022] POST /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:13:17.232580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-fca5e73f-a04f-4c5c-a3c6-ec510efa2c98 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054022931" status: 202 len: 0 microversion: 2.1 time: 0.022033 May 25 17:13:17.232580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 286/551] 10.222.0.31 () {58 vars in 1220 bytes} [Wed May 25 17:13:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054022931 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 17:13:17.237566 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ae6e5cad-9f12-4541-b41e-469acad08b69 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:17.238349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ae6e5cad-9f12-4541-b41e-469acad08b69 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:17.245395 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ae6e5cad-9f12-4541-b41e-469acad08b69 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:17.245860 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ae6e5cad-9f12-4541-b41e-469acad08b69 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:17.246636 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ae6e5cad-9f12-4541-b41e-469acad08b69 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:17.247077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ae6e5cad-9f12-4541-b41e-469acad08b69 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:17.431091 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ae6e5cad-9f12-4541-b41e-469acad08b69 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:17.440082 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ae6e5cad-9f12-4541-b41e-469acad08b69 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1662 microversion: 2.1 time: 0.206511 May 25 17:13:17.440784 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 266/552] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:17 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1662 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:17.899253 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8a81a0fa-b099-4790-8288-3e9da2e35332 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:17.899947 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8a81a0fa-b099-4790-8288-3e9da2e35332 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:17.907673 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8a81a0fa-b099-4790-8288-3e9da2e35332 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:17.908131 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8a81a0fa-b099-4790-8288-3e9da2e35332 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:17.908924 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8a81a0fa-b099-4790-8288-3e9da2e35332 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:17.909355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8a81a0fa-b099-4790-8288-3e9da2e35332 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:17.937987 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d805ed0c-38f3-4ed4-8bfe-ea70dc2f5337 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: .version_select at 0x7f3d4e9904c0>, body: {"keypair": {"name": "tempest-keypair-1806057832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNo8JQ11JUCYabCaJreOdfOORygOmdx5//hLGr6qagV18gWBGuV1KROGcsJcjtmOZUccmclzH7hqIUKXoaJLUWoWfxLVy9RDZx1VFa7d/4sNLxAADeSWpqJGeFtxwuE1w=="}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:17.953103 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-d805ed0c-38f3-4ed4-8bfe-ea70dc2f5337 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:13:17.957046 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-d805ed0c-38f3-4ed4-8bfe-ea70dc2f5337 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for user 3fb5eecf3e244058905ea3aba8112320 and project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:13:17.980397 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d805ed0c-38f3-4ed4-8bfe-ea70dc2f5337 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045334 May 25 17:13:17.981056 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 267/553] 10.222.0.31 () {60 vars in 1158 bytes} [Wed May 25 17:13:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:13:18.045758 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8a81a0fa-b099-4790-8288-3e9da2e35332 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:18.053716 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8a81a0fa-b099-4790-8288-3e9da2e35332 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.158360 May 25 17:13:18.054309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 287/554] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:17 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:18.457848 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-66a04123-dcae-42bf-b7b7-d2df6a95d3c5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:18.458629 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-66a04123-dcae-42bf-b7b7-d2df6a95d3c5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:18.466755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-66a04123-dcae-42bf-b7b7-d2df6a95d3c5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:18.467488 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-66a04123-dcae-42bf-b7b7-d2df6a95d3c5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:18.468525 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-66a04123-dcae-42bf-b7b7-d2df6a95d3c5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:18.469141 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-66a04123-dcae-42bf-b7b7-d2df6a95d3c5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:18.507052 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a2d12c28-a1b7-4aec-9e02-0c175a4be95f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:18.508050 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a2d12c28-a1b7-4aec-9e02-0c175a4be95f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:18.516207 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a2d12c28-a1b7-4aec-9e02-0c175a4be95f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:18.517049 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a2d12c28-a1b7-4aec-9e02-0c175a4be95f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:18.518032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a2d12c28-a1b7-4aec-9e02-0c175a4be95f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:18.519468 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a2d12c28-a1b7-4aec-9e02-0c175a4be95f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:18.558936 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a2d12c28-a1b7-4aec-9e02-0c175a4be95f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments/4b6b799f-87b5-4abf-aaae-2849d806d3ca" status: 200 len: 194 microversion: 2.20 time: 0.057126 May 25 17:13:18.560489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 288/555] 10.222.0.31 () {60 vars in 1453 bytes} [Wed May 25 17:13:18 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments/4b6b799f-87b5-4abf-aaae-2849d806d3ca => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 17:13:18.625716 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-66a04123-dcae-42bf-b7b7-d2df6a95d3c5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:18.631102 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1ebae0f8-e9ac-4ac2-9d30-0e229d771c67 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:18.631680 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1ebae0f8-e9ac-4ac2-9d30-0e229d771c67 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:18.634929 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-66a04123-dcae-42bf-b7b7-d2df6a95d3c5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1662 microversion: 2.1 time: 0.180896 May 25 17:13:18.636715 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 268/556] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:18 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1662 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:18.639060 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1ebae0f8-e9ac-4ac2-9d30-0e229d771c67 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:18.639587 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1ebae0f8-e9ac-4ac2-9d30-0e229d771c67 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:18.640450 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1ebae0f8-e9ac-4ac2-9d30-0e229d771c67 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:18.641187 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1ebae0f8-e9ac-4ac2-9d30-0e229d771c67 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:18.726803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-1ebae0f8-e9ac-4ac2-9d30-0e229d771c67 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lazy-loading 'services' on Instance uuid c99e2d9c-ac45-4a8e-8076-faaf830c29e0 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:13:18.837553 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1ebae0f8-e9ac-4ac2-9d30-0e229d771c67 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments/4b6b799f-87b5-4abf-aaae-2849d806d3ca" status: 202 len: 0 microversion: 2.20 time: 0.210007 May 25 17:13:18.839032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 289/557] 10.222.0.31 () {60 vars in 1456 bytes} [Wed May 25 17:13:18 2022] DELETE /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments/4b6b799f-87b5-4abf-aaae-2849d806d3ca => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 25 17:13:18.848331 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-75450691-db96-43d3-a7a0-4fb461f279c2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:18.849518 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-75450691-db96-43d3-a7a0-4fb461f279c2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:18.857304 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75450691-db96-43d3-a7a0-4fb461f279c2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:18.857674 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75450691-db96-43d3-a7a0-4fb461f279c2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:18.858490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75450691-db96-43d3-a7a0-4fb461f279c2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:18.858963 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75450691-db96-43d3-a7a0-4fb461f279c2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:18.891643 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-75450691-db96-43d3-a7a0-4fb461f279c2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047894 May 25 17:13:18.895671 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 269/558] 10.222.0.31 () {60 vars in 1342 bytes} [Wed May 25 17:13:18 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:13:19.071797 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-92e0258e-7d5b-4b73-919e-c00fec1897cd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:19.073263 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-92e0258e-7d5b-4b73-919e-c00fec1897cd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:19.079618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92e0258e-7d5b-4b73-919e-c00fec1897cd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:19.080150 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92e0258e-7d5b-4b73-919e-c00fec1897cd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:19.081027 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92e0258e-7d5b-4b73-919e-c00fec1897cd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:19.081474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92e0258e-7d5b-4b73-919e-c00fec1897cd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:19.305181 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-92e0258e-7d5b-4b73-919e-c00fec1897cd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:19.316312 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-92e0258e-7d5b-4b73-919e-c00fec1897cd tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1736 microversion: 2.1 time: 0.249084 May 25 17:13:19.316921 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 290/559] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:19 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:19.430854 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-420781122", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94689dfe-6d66-4ed0-9452-eee0a515d2d3"}], "security_groups": [{"name": "tempest-securitygroup--2061141012"}], "key_name": "tempest-keypair-1806057832", "user_data": "}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:19.534903 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] validate_networks() for [('94689dfe-6d66-4ed0-9452-eee0a515d2d3', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:13:19.654231 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8cc1de41-c29c-4e16-a62b-fb53739b0d51 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:19.654869 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8cc1de41-c29c-4e16-a62b-fb53739b0d51 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:19.660896 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8cc1de41-c29c-4e16-a62b-fb53739b0d51 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:19.661354 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8cc1de41-c29c-4e16-a62b-fb53739b0d51 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:19.662119 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8cc1de41-c29c-4e16-a62b-fb53739b0d51 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:19.662563 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8cc1de41-c29c-4e16-a62b-fb53739b0d51 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:19.814566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8cc1de41-c29c-4e16-a62b-fb53739b0d51 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:19.831793 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8cc1de41-c29c-4e16-a62b-fb53739b0d51 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1662 microversion: 2.1 time: 0.181778 May 25 17:13:19.833236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 291/560] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:19 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1662 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:19.904028 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ed2b8e90-b657-44a0-be2d-965ca91234b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:19.905056 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ed2b8e90-b657-44a0-be2d-965ca91234b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:19.911055 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ed2b8e90-b657-44a0-be2d-965ca91234b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:19.911525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ed2b8e90-b657-44a0-be2d-965ca91234b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:19.912265 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ed2b8e90-b657-44a0-be2d-965ca91234b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:19.912728 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ed2b8e90-b657-44a0-be2d-965ca91234b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:19.943723 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ed2b8e90-b657-44a0-be2d-965ca91234b1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044280 May 25 17:13:19.944290 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 292/561] 10.222.0.31 () {60 vars in 1342 bytes} [Wed May 25 17:13:19 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 17:13:19.984031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:13:19.984459 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:13:19.984972 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:13:19.985388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:13:19.985803 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:13:19.995140 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:19.995593 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:19.996400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:19.996878 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.013311 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:13:20.017249 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for user 3fb5eecf3e244058905ea3aba8112320 and project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:13:20.028556 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:13:20.030813 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:13:20.077212 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9249b199-60b9-426e-ab4a-1b5a1650d087 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.650545 May 25 17:13:20.077861 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 270/562] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:13:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:13:20.087660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e1a5ae12-df60-484b-992a-ee663f418759 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:20.088301 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e1a5ae12-df60-484b-992a-ee663f418759 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:20.145874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e1a5ae12-df60-484b-992a-ee663f418759 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:20.152874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e1a5ae12-df60-484b-992a-ee663f418759 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1241 microversion: 2.1 time: 0.068945 May 25 17:13:20.153441 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 293/563] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:20 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:20.333889 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6c15f541-4e0f-4e14-9ed0-288e88e553e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:20.334496 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6c15f541-4e0f-4e14-9ed0-288e88e553e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:20.341598 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c15f541-4e0f-4e14-9ed0-288e88e553e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:20.342075 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c15f541-4e0f-4e14-9ed0-288e88e553e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.342832 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c15f541-4e0f-4e14-9ed0-288e88e553e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:20.343256 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c15f541-4e0f-4e14-9ed0-288e88e553e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.482417 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6c15f541-4e0f-4e14-9ed0-288e88e553e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:20.490463 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6c15f541-4e0f-4e14-9ed0-288e88e553e0 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1716 microversion: 2.1 time: 0.160423 May 25 17:13:20.490971 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 271/564] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:20 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:20.595569 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4955d2f5-0034-4e04-a246-4ffa1ca6a741 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:20.596814 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4955d2f5-0034-4e04-a246-4ffa1ca6a741 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:20.606354 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4955d2f5-0034-4e04-a246-4ffa1ca6a741 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:20.606789 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4955d2f5-0034-4e04-a246-4ffa1ca6a741 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.607563 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4955d2f5-0034-4e04-a246-4ffa1ca6a741 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:20.608009 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4955d2f5-0034-4e04-a246-4ffa1ca6a741 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.697150 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-4955d2f5-0034-4e04-a246-4ffa1ca6a741 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] HTTP exception thrown: Cannot 'detach_volume' instance 377df57f-c46c-4107-99f6-3d8ce8707e39 while it is in vm_state rescued May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4955d2f5-0034-4e04-a246-4ffa1ca6a741 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Request method failure captured: May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: DELETE /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments/fa48b200-1aa3-4e4b-b165-cc159649fe16 HTTP/1.1 May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLGYNd6G28K1F5Vwuevv8bNAGGyG1KQn063AvRNDkhQrhv_VbNEELILAkCaqLFEwEvi0Dvqfjkudz0zR6iHLoRxopgyicuFaijxVda3PK2EFG_6MHUTTsVLuxNFtbXb3F8H7RaOoUvDqTOonq2st05ntld3RmPG6CBG3ac_shdb1ug May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 8c297ec7b46943f594b67c95479f1f7c May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:13:20.700110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/8c297ec7b46943f594b67c95479f1f7c"}]}] May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 8c297ec7b46943f594b67c95479f1f7c May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-ServerRescueNegativeTestJSON-122117092-project May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3f51c03f7fe54451b49ddb32fc337b98 May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-122117092-project May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:13:20.701421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Cannot 'detach_volume' instance 377df57f-c46c-4107-99f6-3d8ce8707e39 while it is in vm_state rescued May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'server_id': '377df57f-c46c-4107-99f6-3d8ce8707e39', 'id': 'fa48b200-1aa3-4e4b-b165-cc159649fe16'} May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 377df57f-c46c-4107-99f6-3d8ce8707e39 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:13:20.702068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 377df57f-c46c-4107-99f6-3d8ce8707e39 while it is in vm_state rescued May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 377df57f-c46c-4107-99f6-3d8ce8707e39 while it is in vm_state rescued May 25 17:13:20.703212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:20.705209 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4955d2f5-0034-4e04-a246-4ffa1ca6a741 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Returning 409 to user: Cannot 'detach_volume' instance 377df57f-c46c-4107-99f6-3d8ce8707e39 while it is in vm_state rescued {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:13:20.706015 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4955d2f5-0034-4e04-a246-4ffa1ca6a741 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "DELETE /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments/fa48b200-1aa3-4e4b-b165-cc159649fe16" status: 409 len: 152 microversion: 2.1 time: 0.115115 May 25 17:13:20.706571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 294/565] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:13:20 2022] DELETE /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments/fa48b200-1aa3-4e4b-b165-cc159649fe16 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 17:13:20.715974 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c23afd31-89f1-4e35-8a27-367ef26e0aa3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:20.716512 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c23afd31-89f1-4e35-8a27-367ef26e0aa3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:20.722586 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c23afd31-89f1-4e35-8a27-367ef26e0aa3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:20.723039 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c23afd31-89f1-4e35-8a27-367ef26e0aa3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.724259 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c23afd31-89f1-4e35-8a27-367ef26e0aa3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:20.724887 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c23afd31-89f1-4e35-8a27-367ef26e0aa3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.803280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c23afd31-89f1-4e35-8a27-367ef26e0aa3 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "POST /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/action" status: 202 len: 0 microversion: 2.1 time: 0.091816 May 25 17:13:20.803910 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 272/566] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:13:20 2022] POST /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:13:20.812885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-240d690f-3209-4914-8acf-7aa4fd1cc1b8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:20.813496 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-240d690f-3209-4914-8acf-7aa4fd1cc1b8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:20.819457 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-240d690f-3209-4914-8acf-7aa4fd1cc1b8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:20.819909 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-240d690f-3209-4914-8acf-7aa4fd1cc1b8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.820668 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-240d690f-3209-4914-8acf-7aa4fd1cc1b8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:20.821134 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-240d690f-3209-4914-8acf-7aa4fd1cc1b8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.849234 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c27598a4-998e-47df-a947-c57f710b627b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:20.850029 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c27598a4-998e-47df-a947-c57f710b627b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:20.857595 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c27598a4-998e-47df-a947-c57f710b627b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:20.858047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c27598a4-998e-47df-a947-c57f710b627b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.858815 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c27598a4-998e-47df-a947-c57f710b627b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:20.859250 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c27598a4-998e-47df-a947-c57f710b627b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:20.863426 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:20.967344 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-240d690f-3209-4914-8acf-7aa4fd1cc1b8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:20.975671 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-240d690f-3209-4914-8acf-7aa4fd1cc1b8 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1724 microversion: 2.1 time: 0.166851 May 25 17:13:20.984911 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 295/567] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:20 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:20.991013 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2166fe99-ffb8-4a29-b099-521adc90df21 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:20.992262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2166fe99-ffb8-4a29-b099-521adc90df21 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:20.998603 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c27598a4-998e-47df-a947-c57f710b627b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:20.999530 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2166fe99-ffb8-4a29-b099-521adc90df21 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:21.000094 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2166fe99-ffb8-4a29-b099-521adc90df21 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:21.001013 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2166fe99-ffb8-4a29-b099-521adc90df21 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:21.001685 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2166fe99-ffb8-4a29-b099-521adc90df21 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:21.006476 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c27598a4-998e-47df-a947-c57f710b627b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1662 microversion: 2.1 time: 0.161478 May 25 17:13:21.007233 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 273/568] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:20 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:21.035624 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2166fe99-ffb8-4a29-b099-521adc90df21 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049427 May 25 17:13:21.036379 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 296/569] 10.222.0.31 () {60 vars in 1342 bytes} [Wed May 25 17:13:20 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:13:21.169742 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-af1c5dec-e26f-4861-8d50-a7fb8049c3b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:21.170413 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-af1c5dec-e26f-4861-8d50-a7fb8049c3b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:21.176626 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af1c5dec-e26f-4861-8d50-a7fb8049c3b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:21.177118 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af1c5dec-e26f-4861-8d50-a7fb8049c3b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:21.177883 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af1c5dec-e26f-4861-8d50-a7fb8049c3b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:21.178324 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af1c5dec-e26f-4861-8d50-a7fb8049c3b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:21.241843 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-af1c5dec-e26f-4861-8d50-a7fb8049c3b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:21.250365 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-af1c5dec-e26f-4861-8d50-a7fb8049c3b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1237 microversion: 2.1 time: 0.085114 May 25 17:13:21.251264 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 274/570] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:21 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:21.993423 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e0139d90-b0d9-4745-a453-2f60eed4cf6b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:21.993958 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e0139d90-b0d9-4745-a453-2f60eed4cf6b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:22.000612 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e0139d90-b0d9-4745-a453-2f60eed4cf6b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:22.001101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e0139d90-b0d9-4745-a453-2f60eed4cf6b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:22.001870 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e0139d90-b0d9-4745-a453-2f60eed4cf6b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:22.002311 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e0139d90-b0d9-4745-a453-2f60eed4cf6b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:22.023789 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-662ec645-868d-4f0c-aa79-a1bd297c6f5f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:22.024397 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-662ec645-868d-4f0c-aa79-a1bd297c6f5f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:22.031975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-662ec645-868d-4f0c-aa79-a1bd297c6f5f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:22.032429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-662ec645-868d-4f0c-aa79-a1bd297c6f5f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:22.033223 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-662ec645-868d-4f0c-aa79-a1bd297c6f5f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:22.033662 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-662ec645-868d-4f0c-aa79-a1bd297c6f5f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:22.132080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e0139d90-b0d9-4745-a453-2f60eed4cf6b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:22.143136 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e0139d90-b0d9-4745-a453-2f60eed4cf6b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1724 microversion: 2.1 time: 0.153446 May 25 17:13:22.143726 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 297/571] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:21 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:22.155123 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ccf03999-9d65-41fa-bbd7-31577dba5287 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:22.156224 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ccf03999-9d65-41fa-bbd7-31577dba5287 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:22.162415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ccf03999-9d65-41fa-bbd7-31577dba5287 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:22.162903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ccf03999-9d65-41fa-bbd7-31577dba5287 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:22.163704 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ccf03999-9d65-41fa-bbd7-31577dba5287 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:22.164146 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ccf03999-9d65-41fa-bbd7-31577dba5287 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:22.171350 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-662ec645-868d-4f0c-aa79-a1bd297c6f5f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:22.178882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-662ec645-868d-4f0c-aa79-a1bd297c6f5f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1666 microversion: 2.1 time: 0.159023 May 25 17:13:22.179448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 275/572] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:22 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:22.190082 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:22.195273 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ccf03999-9d65-41fa-bbd7-31577dba5287 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046186 May 25 17:13:22.195823 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 298/573] 10.222.0.31 () {60 vars in 1342 bytes} [Wed May 25 17:13:22 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:13:22.267413 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e30ad4c2-263c-4956-bb5e-0448bfa6ebc8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:22.267964 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e30ad4c2-263c-4956-bb5e-0448bfa6ebc8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:22.273998 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e30ad4c2-263c-4956-bb5e-0448bfa6ebc8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:22.274452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e30ad4c2-263c-4956-bb5e-0448bfa6ebc8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:22.275218 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e30ad4c2-263c-4956-bb5e-0448bfa6ebc8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:22.276297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e30ad4c2-263c-4956-bb5e-0448bfa6ebc8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:22.336603 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e30ad4c2-263c-4956-bb5e-0448bfa6ebc8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:22.344748 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e30ad4c2-263c-4956-bb5e-0448bfa6ebc8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1293 microversion: 2.1 time: 0.081233 May 25 17:13:22.345315 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 276/574] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:22 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:23.161514 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-43f9ba77-f2c2-4d52-a165-feee2edeed99 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:23.162085 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-43f9ba77-f2c2-4d52-a165-feee2edeed99 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:23.170618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-43f9ba77-f2c2-4d52-a165-feee2edeed99 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:23.171067 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-43f9ba77-f2c2-4d52-a165-feee2edeed99 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:23.171829 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-43f9ba77-f2c2-4d52-a165-feee2edeed99 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:23.172257 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-43f9ba77-f2c2-4d52-a165-feee2edeed99 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:23.212013 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b694a2a8-2bb5-4727-bbb3-914c3a25e521 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:23.214001 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b694a2a8-2bb5-4727-bbb3-914c3a25e521 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:23.221302 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b694a2a8-2bb5-4727-bbb3-914c3a25e521 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:23.221757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b694a2a8-2bb5-4727-bbb3-914c3a25e521 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:23.222541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b694a2a8-2bb5-4727-bbb3-914c3a25e521 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:23.222982 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b694a2a8-2bb5-4727-bbb3-914c3a25e521 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:23.256232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b694a2a8-2bb5-4727-bbb3-914c3a25e521 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052761 May 25 17:13:23.256826 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 277/575] 10.222.0.31 () {60 vars in 1342 bytes} [Wed May 25 17:13:23 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 17:13:23.304263 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-43f9ba77-f2c2-4d52-a165-feee2edeed99 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:23.313101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-43f9ba77-f2c2-4d52-a165-feee2edeed99 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1724 microversion: 2.1 time: 0.155395 May 25 17:13:23.313659 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 299/576] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:23 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:23.361450 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4a8722a5-38a8-4ed2-8ab8-2587d7c89309 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:23.362055 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4a8722a5-38a8-4ed2-8ab8-2587d7c89309 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:23.367994 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a8722a5-38a8-4ed2-8ab8-2587d7c89309 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:23.368466 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a8722a5-38a8-4ed2-8ab8-2587d7c89309 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:23.369265 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a8722a5-38a8-4ed2-8ab8-2587d7c89309 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:23.370140 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a8722a5-38a8-4ed2-8ab8-2587d7c89309 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:23.430558 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4a8722a5-38a8-4ed2-8ab8-2587d7c89309 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:23.439147 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4a8722a5-38a8-4ed2-8ab8-2587d7c89309 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1293 microversion: 2.1 time: 0.081545 May 25 17:13:23.439720 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 278/577] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:23 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:24.269326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e8e706cc-76f8-4921-8796-599b26c45992 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:24.270250 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e8e706cc-76f8-4921-8796-599b26c45992 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:24.276918 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8e706cc-76f8-4921-8796-599b26c45992 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:24.277375 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8e706cc-76f8-4921-8796-599b26c45992 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:24.278138 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8e706cc-76f8-4921-8796-599b26c45992 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:24.278577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8e706cc-76f8-4921-8796-599b26c45992 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:24.312310 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e8e706cc-76f8-4921-8796-599b26c45992 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046610 May 25 17:13:24.312938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 300/578] 10.222.0.31 () {60 vars in 1342 bytes} [Wed May 25 17:13:24 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:13:24.330724 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-73dcc545-a276-4404-b97c-ab22510b6519 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:24.332163 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-73dcc545-a276-4404-b97c-ab22510b6519 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:24.341564 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73dcc545-a276-4404-b97c-ab22510b6519 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:24.342409 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73dcc545-a276-4404-b97c-ab22510b6519 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:24.342949 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73dcc545-a276-4404-b97c-ab22510b6519 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:24.343407 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73dcc545-a276-4404-b97c-ab22510b6519 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:24.457315 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-55b23efc-354f-4da2-997b-bd7d7f50eb0f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:24.457934 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-55b23efc-354f-4da2-997b-bd7d7f50eb0f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:24.464491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-55b23efc-354f-4da2-997b-bd7d7f50eb0f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:24.465164 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-55b23efc-354f-4da2-997b-bd7d7f50eb0f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:24.465960 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-55b23efc-354f-4da2-997b-bd7d7f50eb0f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:24.466619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-55b23efc-354f-4da2-997b-bd7d7f50eb0f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:24.532441 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-55b23efc-354f-4da2-997b-bd7d7f50eb0f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:24.539800 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-55b23efc-354f-4da2-997b-bd7d7f50eb0f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1293 microversion: 2.1 time: 0.086375 May 25 17:13:24.540373 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 301/579] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:24 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:24.546564 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-73dcc545-a276-4404-b97c-ab22510b6519 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:24.554531 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-73dcc545-a276-4404-b97c-ab22510b6519 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1724 microversion: 2.1 time: 0.227732 May 25 17:13:24.555087 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 279/580] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:24 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:25.325214 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-afee97ac-9ed0-46c1-83bd-3ed3f4b93ed9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:25.326926 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-afee97ac-9ed0-46c1-83bd-3ed3f4b93ed9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:25.334227 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-afee97ac-9ed0-46c1-83bd-3ed3f4b93ed9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:25.335141 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-afee97ac-9ed0-46c1-83bd-3ed3f4b93ed9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:25.336267 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-afee97ac-9ed0-46c1-83bd-3ed3f4b93ed9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:25.336771 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-afee97ac-9ed0-46c1-83bd-3ed3f4b93ed9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:25.370085 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-afee97ac-9ed0-46c1-83bd-3ed3f4b93ed9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050153 May 25 17:13:25.372890 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 302/581] 10.222.0.31 () {60 vars in 1342 bytes} [Wed May 25 17:13:25 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:25.442831 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-19710897-4aad-48f5-a1e8-ae8ccc16e50b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:25.442831 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-19710897-4aad-48f5-a1e8-ae8ccc16e50b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:25.453263 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19710897-4aad-48f5-a1e8-ae8ccc16e50b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:25.453822 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19710897-4aad-48f5-a1e8-ae8ccc16e50b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:25.454873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19710897-4aad-48f5-a1e8-ae8ccc16e50b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:25.455414 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-19710897-4aad-48f5-a1e8-ae8ccc16e50b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:25.488416 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-19710897-4aad-48f5-a1e8-ae8ccc16e50b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:13:25.563211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ae016bd5-631a-4a9e-8dff-7c73b993211a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:25.564038 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ae016bd5-631a-4a9e-8dff-7c73b993211a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:25.571272 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-19710897-4aad-48f5-a1e8-ae8ccc16e50b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 204 len: 0 microversion: 2.20 time: 0.136483 May 25 17:13:25.571505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ae016bd5-631a-4a9e-8dff-7c73b993211a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:25.571876 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ae016bd5-631a-4a9e-8dff-7c73b993211a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:25.572343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 280/582] 10.222.0.31 () {60 vars in 1279 bytes} [Wed May 25 17:13:25 2022] DELETE /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 17:13:25.576594 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ae016bd5-631a-4a9e-8dff-7c73b993211a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:25.576594 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ae016bd5-631a-4a9e-8dff-7c73b993211a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:25.584668 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bd5ad132-3b1a-4414-a387-90f7b8648e78 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:25.584891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bd5ad132-3b1a-4414-a387-90f7b8648e78 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:25.591738 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bd5ad132-3b1a-4414-a387-90f7b8648e78 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:25.593377 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bd5ad132-3b1a-4414-a387-90f7b8648e78 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:25.593614 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bd5ad132-3b1a-4414-a387-90f7b8648e78 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:25.594056 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bd5ad132-3b1a-4414-a387-90f7b8648e78 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:25.646044 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ae016bd5-631a-4a9e-8dff-7c73b993211a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:25.654538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ae016bd5-631a-4a9e-8dff-7c73b993211a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1299 microversion: 2.1 time: 0.101596 May 25 17:13:25.655104 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 303/583] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:25 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:25.659494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c78eece8-a70b-460c-8772-7576b2fe5560 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:25.660307 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c78eece8-a70b-460c-8772-7576b2fe5560 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:25.667440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c78eece8-a70b-460c-8772-7576b2fe5560 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:25.667890 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c78eece8-a70b-460c-8772-7576b2fe5560 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:25.668663 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c78eece8-a70b-460c-8772-7576b2fe5560 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:25.669125 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c78eece8-a70b-460c-8772-7576b2fe5560 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:25.796490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bd5ad132-3b1a-4414-a387-90f7b8648e78 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:25.800338 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c78eece8-a70b-460c-8772-7576b2fe5560 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:25.810303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c78eece8-a70b-460c-8772-7576b2fe5560 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:25.813295 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c78eece8-a70b-460c-8772-7576b2fe5560 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:25.814581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c78eece8-a70b-460c-8772-7576b2fe5560 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.158548 May 25 17:13:25.815551 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 304/584] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:25 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:25.823627 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bd5ad132-3b1a-4414-a387-90f7b8648e78 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1724 microversion: 2.1 time: 0.248343 May 25 17:13:25.824435 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 281/585] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:25 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:26.671332 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-861e409c-b4ae-4a17-88da-20cc60e92077 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:26.671956 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-861e409c-b4ae-4a17-88da-20cc60e92077 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:26.678857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-861e409c-b4ae-4a17-88da-20cc60e92077 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:26.679310 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-861e409c-b4ae-4a17-88da-20cc60e92077 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:26.680109 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-861e409c-b4ae-4a17-88da-20cc60e92077 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:26.680552 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-861e409c-b4ae-4a17-88da-20cc60e92077 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:26.810832 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-861e409c-b4ae-4a17-88da-20cc60e92077 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:26.818450 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-861e409c-b4ae-4a17-88da-20cc60e92077 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1367 microversion: 2.1 time: 0.151248 May 25 17:13:26.819015 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 305/586] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:26 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:26.834483 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-085bdf8e-1771-4e90-8754-78b931a5f708 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:26.835135 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-085bdf8e-1771-4e90-8754-78b931a5f708 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:26.840081 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a8162239-4215-4049-9108-906253657520 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:26.840716 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a8162239-4215-4049-9108-906253657520 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:26.842451 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-085bdf8e-1771-4e90-8754-78b931a5f708 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:26.842900 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-085bdf8e-1771-4e90-8754-78b931a5f708 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:26.843667 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-085bdf8e-1771-4e90-8754-78b931a5f708 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:26.844102 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-085bdf8e-1771-4e90-8754-78b931a5f708 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:26.846618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a8162239-4215-4049-9108-906253657520 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:26.847066 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a8162239-4215-4049-9108-906253657520 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:26.847827 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a8162239-4215-4049-9108-906253657520 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:26.848264 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a8162239-4215-4049-9108-906253657520 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:26.977324 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-085bdf8e-1771-4e90-8754-78b931a5f708 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:26.978074 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a8162239-4215-4049-9108-906253657520 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:26.986400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-085bdf8e-1771-4e90-8754-78b931a5f708 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:26.987851 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-085bdf8e-1771-4e90-8754-78b931a5f708 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:26.988275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a8162239-4215-4049-9108-906253657520 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1724 microversion: 2.1 time: 0.151953 May 25 17:13:26.988947 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 306/587] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:26 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:26.989085 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-085bdf8e-1771-4e90-8754-78b931a5f708 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.158388 May 25 17:13:26.989582 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 282/588] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:26 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:27.835364 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-85cc42cd-9a46-4cdb-97eb-acd1b01ddc00 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:27.835974 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-85cc42cd-9a46-4cdb-97eb-acd1b01ddc00 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:27.843254 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85cc42cd-9a46-4cdb-97eb-acd1b01ddc00 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:27.843705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85cc42cd-9a46-4cdb-97eb-acd1b01ddc00 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:27.844463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85cc42cd-9a46-4cdb-97eb-acd1b01ddc00 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:27.844932 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85cc42cd-9a46-4cdb-97eb-acd1b01ddc00 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:27.973029 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-85cc42cd-9a46-4cdb-97eb-acd1b01ddc00 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:27.981035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-85cc42cd-9a46-4cdb-97eb-acd1b01ddc00 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1367 microversion: 2.1 time: 0.149371 May 25 17:13:27.981681 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 307/589] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:27 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:28.005897 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-de0e62e5-2551-4cc6-9feb-0b3b9280089a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:28.006730 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-de0e62e5-2551-4cc6-9feb-0b3b9280089a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:28.007590 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c9b04b04-5c4a-43db-826d-5106b19ed0e2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:28.008203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c9b04b04-5c4a-43db-826d-5106b19ed0e2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:28.013776 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de0e62e5-2551-4cc6-9feb-0b3b9280089a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:28.014211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c9b04b04-5c4a-43db-826d-5106b19ed0e2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:28.014386 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de0e62e5-2551-4cc6-9feb-0b3b9280089a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:28.014666 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c9b04b04-5c4a-43db-826d-5106b19ed0e2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:28.015292 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de0e62e5-2551-4cc6-9feb-0b3b9280089a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:28.015433 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c9b04b04-5c4a-43db-826d-5106b19ed0e2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:28.015809 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de0e62e5-2551-4cc6-9feb-0b3b9280089a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:28.015928 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c9b04b04-5c4a-43db-826d-5106b19ed0e2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:28.148568 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-de0e62e5-2551-4cc6-9feb-0b3b9280089a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:28.149029 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c9b04b04-5c4a-43db-826d-5106b19ed0e2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:28.157501 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-de0e62e5-2551-4cc6-9feb-0b3b9280089a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1724 microversion: 2.1 time: 0.155519 May 25 17:13:28.158283 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c9b04b04-5c4a-43db-826d-5106b19ed0e2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:28.158417 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 283/590] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:28 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:28.159667 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c9b04b04-5c4a-43db-826d-5106b19ed0e2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:28.160856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c9b04b04-5c4a-43db-826d-5106b19ed0e2 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.157533 May 25 17:13:28.161407 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 308/591] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:28 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:13:29.000199 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7d5ed962-14e6-48e2-8940-2e7ac3223843 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:29.000837 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7d5ed962-14e6-48e2-8940-2e7ac3223843 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:29.007053 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7d5ed962-14e6-48e2-8940-2e7ac3223843 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:29.007631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7d5ed962-14e6-48e2-8940-2e7ac3223843 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:29.008248 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7d5ed962-14e6-48e2-8940-2e7ac3223843 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:29.008704 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7d5ed962-14e6-48e2-8940-2e7ac3223843 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:29.139618 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7d5ed962-14e6-48e2-8940-2e7ac3223843 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:29.146954 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7d5ed962-14e6-48e2-8940-2e7ac3223843 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1367 microversion: 2.1 time: 0.150634 May 25 17:13:29.147511 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 284/592] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:28 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:29.175452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-07072c9c-fd68-4879-96d1-df1e511c20c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:29.176063 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-07072c9c-fd68-4879-96d1-df1e511c20c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:29.178964 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b3b78e98-4bd3-4288-b941-18c263e0835e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:29.179576 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b3b78e98-4bd3-4288-b941-18c263e0835e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:29.183292 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07072c9c-fd68-4879-96d1-df1e511c20c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:29.183736 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07072c9c-fd68-4879-96d1-df1e511c20c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:29.184491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07072c9c-fd68-4879-96d1-df1e511c20c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:29.184950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07072c9c-fd68-4879-96d1-df1e511c20c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:29.186339 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b3b78e98-4bd3-4288-b941-18c263e0835e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:29.186798 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b3b78e98-4bd3-4288-b941-18c263e0835e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:29.187826 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b3b78e98-4bd3-4288-b941-18c263e0835e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:29.188266 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b3b78e98-4bd3-4288-b941-18c263e0835e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:29.317290 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b3b78e98-4bd3-4288-b941-18c263e0835e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:29.318740 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-07072c9c-fd68-4879-96d1-df1e511c20c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:29.325459 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b3b78e98-4bd3-4288-b941-18c263e0835e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:29.326978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b3b78e98-4bd3-4288-b941-18c263e0835e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:29.327505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-07072c9c-fd68-4879-96d1-df1e511c20c4 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1724 microversion: 2.1 time: 0.156022 May 25 17:13:29.328131 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b3b78e98-4bd3-4288-b941-18c263e0835e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.152962 May 25 17:13:29.328411 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 309/593] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:29 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:29.328705 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 285/594] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:29 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:13:30.163495 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a32016c1-d931-439f-ad80-f6a010e98a77 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:30.164223 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a32016c1-d931-439f-ad80-f6a010e98a77 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:30.166335 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:30.172544 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a32016c1-d931-439f-ad80-f6a010e98a77 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:30.173122 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a32016c1-d931-439f-ad80-f6a010e98a77 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:30.173904 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a32016c1-d931-439f-ad80-f6a010e98a77 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:30.174340 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a32016c1-d931-439f-ad80-f6a010e98a77 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:30.320353 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a32016c1-d931-439f-ad80-f6a010e98a77 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:30.329033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a32016c1-d931-439f-ad80-f6a010e98a77 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1367 microversion: 2.1 time: 0.169354 May 25 17:13:30.329665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 310/595] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:30 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:30.345007 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b4ab549b-ebbb-46b6-a6d4-6c16aa2c0b39 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:30.345627 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b4ab549b-ebbb-46b6-a6d4-6c16aa2c0b39 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:30.347508 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-679e9deb-b3b7-41eb-9316-f44649b73f93 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:30.348195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-679e9deb-b3b7-41eb-9316-f44649b73f93 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:30.349141 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:30.350496 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=10 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:30.354984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-679e9deb-b3b7-41eb-9316-f44649b73f93 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:30.355436 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-679e9deb-b3b7-41eb-9316-f44649b73f93 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:30.356071 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4ab549b-ebbb-46b6-a6d4-6c16aa2c0b39 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:30.356308 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-679e9deb-b3b7-41eb-9316-f44649b73f93 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:30.356627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-679e9deb-b3b7-41eb-9316-f44649b73f93 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:30.356937 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4ab549b-ebbb-46b6-a6d4-6c16aa2c0b39 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:30.357723 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4ab549b-ebbb-46b6-a6d4-6c16aa2c0b39 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:30.358170 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4ab549b-ebbb-46b6-a6d4-6c16aa2c0b39 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:30.520855 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-679e9deb-b3b7-41eb-9316-f44649b73f93 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:30.531455 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-679e9deb-b3b7-41eb-9316-f44649b73f93 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:30.533349 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-679e9deb-b3b7-41eb-9316-f44649b73f93 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:30.535175 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-679e9deb-b3b7-41eb-9316-f44649b73f93 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1722 microversion: 2.20 time: 0.192636 May 25 17:13:30.536296 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 311/596] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:30 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:13:30.685486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b4ab549b-ebbb-46b6-a6d4-6c16aa2c0b39 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:30.696255 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b4ab549b-ebbb-46b6-a6d4-6c16aa2c0b39 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1724 microversion: 2.1 time: 0.355417 May 25 17:13:30.697024 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 286/597] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:30 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:31.020819 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-17550c38-5b8f-4f0f-ab64-16802b215634 req-8b082c03-c611-400d-96fe-478398f83773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d856fd3d-ee9c-45ec-b4a1-46789378a5ef", "tag": "df2173ff-664e-43ca-b7a5-ee5bf4830547"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:31.033682 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-17550c38-5b8f-4f0f-ab64-16802b215634 req-8b082c03-c611-400d-96fe-478398f83773 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:31.034061 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-17550c38-5b8f-4f0f-ab64-16802b215634 req-8b082c03-c611-400d-96fe-478398f83773 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:31.047290 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-17550c38-5b8f-4f0f-ab64-16802b215634 req-8b082c03-c611-400d-96fe-478398f83773 service nova] Creating event network-changed:df2173ff-664e-43ca-b7a5-ee5bf4830547 for instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef on hv-cinder-84330 May 25 17:13:31.052810 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-17550c38-5b8f-4f0f-ab64-16802b215634 req-8b082c03-c611-400d-96fe-478398f83773 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038203 May 25 17:13:31.053430 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 312/598] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:31.346301 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-56734577-5af3-427e-8a5c-6244fa02ebc5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:31.346941 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-56734577-5af3-427e-8a5c-6244fa02ebc5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:31.357313 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56734577-5af3-427e-8a5c-6244fa02ebc5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:31.357770 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56734577-5af3-427e-8a5c-6244fa02ebc5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:31.358547 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56734577-5af3-427e-8a5c-6244fa02ebc5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:31.358984 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56734577-5af3-427e-8a5c-6244fa02ebc5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:31.555906 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-769e4811-716b-4cb2-b774-9cb59ba23cf4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:31.557340 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-769e4811-716b-4cb2-b774-9cb59ba23cf4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:31.564579 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-769e4811-716b-4cb2-b774-9cb59ba23cf4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:31.565142 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-769e4811-716b-4cb2-b774-9cb59ba23cf4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:31.565924 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-769e4811-716b-4cb2-b774-9cb59ba23cf4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:31.566369 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-769e4811-716b-4cb2-b774-9cb59ba23cf4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:31.632041 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-769e4811-716b-4cb2-b774-9cb59ba23cf4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:31.641013 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-769e4811-716b-4cb2-b774-9cb59ba23cf4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:31.642561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-769e4811-716b-4cb2-b774-9cb59ba23cf4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:31.643727 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-769e4811-716b-4cb2-b774-9cb59ba23cf4 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1655 microversion: 2.20 time: 0.092153 May 25 17:13:31.644295 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 313/599] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:31 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:13:31.708869 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-56734577-5af3-427e-8a5c-6244fa02ebc5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:31.714554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b96367c6-a00f-42a2-bc40-78fd9cd6b57f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:31.715005 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b96367c6-a00f-42a2-bc40-78fd9cd6b57f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:31.717345 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-56734577-5af3-427e-8a5c-6244fa02ebc5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1367 microversion: 2.1 time: 0.374992 May 25 17:13:31.718513 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 287/600] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:31 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:31.721592 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b96367c6-a00f-42a2-bc40-78fd9cd6b57f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:31.722047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b96367c6-a00f-42a2-bc40-78fd9cd6b57f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:31.723008 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b96367c6-a00f-42a2-bc40-78fd9cd6b57f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:31.723462 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b96367c6-a00f-42a2-bc40-78fd9cd6b57f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:31.874237 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b96367c6-a00f-42a2-bc40-78fd9cd6b57f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:31.882691 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b96367c6-a00f-42a2-bc40-78fd9cd6b57f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1730 microversion: 2.1 time: 0.172101 May 25 17:13:31.883762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 314/601] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:31 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:31.904094 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-255fd600-f944-4e54-b08c-c5f2a6f8e6c7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:31.904603 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-255fd600-f944-4e54-b08c-c5f2a6f8e6c7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:31.911513 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-255fd600-f944-4e54-b08c-c5f2a6f8e6c7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:31.912102 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-255fd600-f944-4e54-b08c-c5f2a6f8e6c7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:31.917619 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-255fd600-f944-4e54-b08c-c5f2a6f8e6c7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:31.918201 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-255fd600-f944-4e54-b08c-c5f2a6f8e6c7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:31.924332 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:32.038117 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-255fd600-f944-4e54-b08c-c5f2a6f8e6c7 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139558 May 25 17:13:32.039057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 288/602] 10.222.0.31 () {58 vars in 1274 bytes} [Wed May 25 17:13:31 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:32.662152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-51e81e90-ddcc-4eee-a873-4a3c5fa7837b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:32.663317 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-51e81e90-ddcc-4eee-a873-4a3c5fa7837b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:32.671247 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-51e81e90-ddcc-4eee-a873-4a3c5fa7837b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:32.671709 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-51e81e90-ddcc-4eee-a873-4a3c5fa7837b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:32.672694 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-51e81e90-ddcc-4eee-a873-4a3c5fa7837b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:32.673292 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-51e81e90-ddcc-4eee-a873-4a3c5fa7837b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:32.735014 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3a0c7d8e-162b-4781-ba18-f95d6bfe1e04 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:32.735719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3a0c7d8e-162b-4781-ba18-f95d6bfe1e04 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:32.744824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a0c7d8e-162b-4781-ba18-f95d6bfe1e04 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:32.745405 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a0c7d8e-162b-4781-ba18-f95d6bfe1e04 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:32.746303 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a0c7d8e-162b-4781-ba18-f95d6bfe1e04 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:32.746848 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a0c7d8e-162b-4781-ba18-f95d6bfe1e04 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:32.762213 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-51e81e90-ddcc-4eee-a873-4a3c5fa7837b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:32.770873 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-51e81e90-ddcc-4eee-a873-4a3c5fa7837b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:32.772711 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-51e81e90-ddcc-4eee-a873-4a3c5fa7837b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:32.774130 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-51e81e90-ddcc-4eee-a873-4a3c5fa7837b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 200 len: 1655 microversion: 2.20 time: 0.115839 May 25 17:13:32.784174 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 315/603] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:32 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 1655 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:33.001319 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4e380dc1-c435-4d38-b50a-d70015118c89 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:33.001947 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4e380dc1-c435-4d38-b50a-d70015118c89 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:33.011192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4e380dc1-c435-4d38-b50a-d70015118c89 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:33.013216 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4e380dc1-c435-4d38-b50a-d70015118c89 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:33.014532 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4e380dc1-c435-4d38-b50a-d70015118c89 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:33.017344 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4e380dc1-c435-4d38-b50a-d70015118c89 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:33.028769 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3a0c7d8e-162b-4781-ba18-f95d6bfe1e04 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:33.034639 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=100 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:33.042528 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3a0c7d8e-162b-4781-ba18-f95d6bfe1e04 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1367 microversion: 2.1 time: 0.311509 May 25 17:13:33.043926 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 289/604] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:32 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:33.074036 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-6eb1164b-aa12-4fe4-8344-cdd40461ec5a req-244841b9-1c27-4bc0-92f1-5f329bc009f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377df57f-c46c-4107-99f6-3d8ce8707e39", "tag": "9f418fcd-8e98-4ba1-96ee-1e27e32eb165"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:33.084029 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6eb1164b-aa12-4fe4-8344-cdd40461ec5a req-244841b9-1c27-4bc0-92f1-5f329bc009f7 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:33.084692 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6eb1164b-aa12-4fe4-8344-cdd40461ec5a req-244841b9-1c27-4bc0-92f1-5f329bc009f7 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:33.100009 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-6eb1164b-aa12-4fe4-8344-cdd40461ec5a req-244841b9-1c27-4bc0-92f1-5f329bc009f7 service nova] Creating event network-changed:9f418fcd-8e98-4ba1-96ee-1e27e32eb165 for instance 377df57f-c46c-4107-99f6-3d8ce8707e39 on hv-cinder-84330 May 25 17:13:33.106009 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-6eb1164b-aa12-4fe4-8344-cdd40461ec5a req-244841b9-1c27-4bc0-92f1-5f329bc009f7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038569 May 25 17:13:33.107259 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 290/605] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:13:33.113725 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-e155ad76-9745-4dd3-b442-bc26d30fd97b req-22f83429-ee2a-4641-9b73-c709c95d30f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99e2d9c-ac45-4a8e-8076-faaf830c29e0", "name": "network-vif-deleted", "tag": "fa9d31d9-985b-4772-a564-1cbeee313f84"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:33.124706 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-e155ad76-9745-4dd3-b442-bc26d30fd97b req-22f83429-ee2a-4641-9b73-c709c95d30f0 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:33.125160 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-e155ad76-9745-4dd3-b442-bc26d30fd97b req-22f83429-ee2a-4641-9b73-c709c95d30f0 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:33.141055 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-e155ad76-9745-4dd3-b442-bc26d30fd97b req-22f83429-ee2a-4641-9b73-c709c95d30f0 service nova] Creating event network-vif-deleted:fa9d31d9-985b-4772-a564-1cbeee313f84 for instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 on hv-cinder-84330 May 25 17:13:33.146831 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-e155ad76-9745-4dd3-b442-bc26d30fd97b req-22f83429-ee2a-4641-9b73-c709c95d30f0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037712 May 25 17:13:33.147021 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 291/606] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:33.151226 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-4e380dc1-c435-4d38-b50a-d70015118c89 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lazy-loading 'services' on Instance uuid 475dd99c-12d2-41dc-8a56-c090ad97daa9 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:13:33.230353 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4e380dc1-c435-4d38-b50a-d70015118c89 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "DELETE /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9/os-volume_attachments/4f9180be-9564-4a4e-a602-4c3a086191ca" status: 202 len: 0 microversion: 2.1 time: 0.233040 May 25 17:13:33.231585 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 316/607] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:13:32 2022] DELETE /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9/os-volume_attachments/4f9180be-9564-4a4e-a602-4c3a086191ca => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:13:33.794005 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-97018779-9751-42b0-9d37-c9147a7a297b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:33.795351 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-97018779-9751-42b0-9d37-c9147a7a297b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:33.807788 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-97018779-9751-42b0-9d37-c9147a7a297b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:33.808569 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-97018779-9751-42b0-9d37-c9147a7a297b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:33.809427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-97018779-9751-42b0-9d37-c9147a7a297b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:33.809862 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-97018779-9751-42b0-9d37-c9147a7a297b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:33.825077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-97018779-9751-42b0-9d37-c9147a7a297b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] HTTP exception thrown: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-97018779-9751-42b0-9d37-c9147a7a297b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Request method failure captured: May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 HTTP/1.1 May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLEZsihvNQ5PQTNLSdjMjiubDB7I6ybyx2g_U0ny8kESLyEmHUmePtdgO6aD3TVfoDROdphZLXTZyhKJrMbajhGodqR1VQg8Sva5WhyR-0xUQq_Nni5m6pl9qCcaScUpqnkUeCLIMfnYl62kJPrq4NmEM3uYRB0PCBbFJN2pXHcHfY May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Openstack-Nova-Api-Version: 2.20 May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:13:33.827196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}] May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 41618b0540e64de4b968d5cdc39bea0a May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:13:33.828727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'c99e2d9c-ac45-4a8e-8076-faaf830c29e0'} May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:13:33.829675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:13:33.830906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:13:33.832945 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-97018779-9751-42b0-9d37-c9147a7a297b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Returning 404 to user: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:13:33.833973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-97018779-9751-42b0-9d37-c9147a7a297b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 404 len: 111 microversion: 2.20 time: 0.045017 May 25 17:13:33.835039 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 292/608] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:33 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 17:13:33.845820 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e08068cb-5a55-4c41-909c-45f7b1133604 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '.version_select at 0x7f3d4e2b6280>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:33.865966 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e08068cb-5a55-4c41-909c-45f7b1133604 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579287270" status: 204 len: 0 microversion: 2.20 time: 0.024986 May 25 17:13:33.866554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 317/609] 10.222.0.31 () {60 vars in 1258 bytes} [Wed May 25 17:13:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579287270 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 17:13:34.062102 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9e4c9c7b-81d2-4d4f-9344-c21bf643023b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:34.062770 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9e4c9c7b-81d2-4d4f-9344-c21bf643023b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:34.069080 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9e4c9c7b-81d2-4d4f-9344-c21bf643023b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:34.069539 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9e4c9c7b-81d2-4d4f-9344-c21bf643023b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:34.070345 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9e4c9c7b-81d2-4d4f-9344-c21bf643023b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:34.071117 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9e4c9c7b-81d2-4d4f-9344-c21bf643023b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:34.363987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7a93a17f-68c3-4a18-a8df-331d16bc7ca3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:34.365022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7a93a17f-68c3-4a18-a8df-331d16bc7ca3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:34.371991 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a93a17f-68c3-4a18-a8df-331d16bc7ca3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:34.372443 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a93a17f-68c3-4a18-a8df-331d16bc7ca3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:34.373445 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a93a17f-68c3-4a18-a8df-331d16bc7ca3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:34.373897 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a93a17f-68c3-4a18-a8df-331d16bc7ca3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:34.401226 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7a93a17f-68c3-4a18-a8df-331d16bc7ca3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:13:34.436579 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9e4c9c7b-81d2-4d4f-9344-c21bf643023b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:34.454334 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9e4c9c7b-81d2-4d4f-9344-c21bf643023b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1367 microversion: 2.1 time: 0.397652 May 25 17:13:34.456360 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 293/610] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:34 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:34.495894 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7a93a17f-68c3-4a18-a8df-331d16bc7ca3 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "DELETE /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 204 len: 0 microversion: 2.1 time: 0.135781 May 25 17:13:34.496984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 318/611] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:13:34 2022] DELETE /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 17:13:34.506971 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-beb96733-9d29-4865-b064-22ee5be782e6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:34.508146 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-beb96733-9d29-4865-b064-22ee5be782e6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:34.516743 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-beb96733-9d29-4865-b064-22ee5be782e6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:34.517914 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-beb96733-9d29-4865-b064-22ee5be782e6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:34.519591 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-beb96733-9d29-4865-b064-22ee5be782e6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:34.520211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-beb96733-9d29-4865-b064-22ee5be782e6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:34.699025 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-beb96733-9d29-4865-b064-22ee5be782e6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:34.709458 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-beb96733-9d29-4865-b064-22ee5be782e6 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1513 microversion: 2.1 time: 0.208117 May 25 17:13:34.710218 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 294/612] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:34 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:35.037997 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4cad3222-c59d-4978-b2e8-426b648a7bf8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Action: 'create', calling method: .version_select at 0x7f3d4e2b6e50>, body: {"keypair": {"name": "tempest-keypair-1844653568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKN69GoTKZf7yryOeK+Ewlrsoblzj/aXcLBrrThlG/KoR3j/cpwZbpyz/YU9F7x3rmuGKVacoeGzVlsfjrkyqIK1Y2Jwjtz50tdBrsmw5jGTnfzfBmtEuWNjISA2YIvEw=="}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:35.052759 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-4cad3222-c59d-4978-b2e8-426b648a7bf8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Getting quotas for project 197671139e6b42069ba82ea9fdf1da40. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:13:35.057396 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-4cad3222-c59d-4978-b2e8-426b648a7bf8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Getting quotas for user 41618b0540e64de4b968d5cdc39bea0a and project 197671139e6b42069ba82ea9fdf1da40. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:13:35.071810 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:35.080201 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4cad3222-c59d-4978-b2e8-426b648a7bf8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046478 May 25 17:13:35.080815 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 319/613] 10.222.0.31 () {62 vars in 1199 bytes} [Wed May 25 17:13:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 25 17:13:35.120704 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-8868e69a-a8ec-46a1-9571-1673661d5bc4 req-5848af69-18e5-4db9-8e98-bc3681fdfdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377df57f-c46c-4107-99f6-3d8ce8707e39", "tag": "9f418fcd-8e98-4ba1-96ee-1e27e32eb165"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:35.129141 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-8868e69a-a8ec-46a1-9571-1673661d5bc4 req-5848af69-18e5-4db9-8e98-bc3681fdfdb9 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:35.129586 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-8868e69a-a8ec-46a1-9571-1673661d5bc4 req-5848af69-18e5-4db9-8e98-bc3681fdfdb9 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:35.141064 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-8868e69a-a8ec-46a1-9571-1673661d5bc4 req-5848af69-18e5-4db9-8e98-bc3681fdfdb9 service nova] Creating event network-changed:9f418fcd-8e98-4ba1-96ee-1e27e32eb165 for instance 377df57f-c46c-4107-99f6-3d8ce8707e39 on hv-cinder-84330 May 25 17:13:35.146431 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-8868e69a-a8ec-46a1-9571-1673661d5bc4 req-5848af69-18e5-4db9-8e98-bc3681fdfdb9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029960 May 25 17:13:35.147232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 295/614] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:13:35.471880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-612f2fa4-414d-4b34-a4c6-0acbe512c31c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:35.472705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-612f2fa4-414d-4b34-a4c6-0acbe512c31c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:35.481886 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-612f2fa4-414d-4b34-a4c6-0acbe512c31c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:35.482342 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-612f2fa4-414d-4b34-a4c6-0acbe512c31c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:35.483119 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-612f2fa4-414d-4b34-a4c6-0acbe512c31c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:35.483562 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-612f2fa4-414d-4b34-a4c6-0acbe512c31c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:35.616732 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-612f2fa4-414d-4b34-a4c6-0acbe512c31c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:35.624519 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-612f2fa4-414d-4b34-a4c6-0acbe512c31c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1367 microversion: 2.1 time: 0.156910 May 25 17:13:35.625127 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 320/615] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:35 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:35.727203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7e07be16-3b1b-405d-b69c-98802bd2e332 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:35.727894 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7e07be16-3b1b-405d-b69c-98802bd2e332 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:35.734095 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7e07be16-3b1b-405d-b69c-98802bd2e332 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:35.734541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7e07be16-3b1b-405d-b69c-98802bd2e332 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:35.735291 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7e07be16-3b1b-405d-b69c-98802bd2e332 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:35.735722 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7e07be16-3b1b-405d-b69c-98802bd2e332 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:35.914753 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7e07be16-3b1b-405d-b69c-98802bd2e332 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:35.923705 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7e07be16-3b1b-405d-b69c-98802bd2e332 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1513 microversion: 2.1 time: 0.200746 May 25 17:13:35.924286 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 296/616] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:35 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:36.553340 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-39abd9a7-d3b8-4505-a5e4-5a09717c3cb6 req-c1fd25cf-8a25-4622-b1c5-c6c34498ccbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d856fd3d-ee9c-45ec-b4a1-46789378a5ef", "name": "network-vif-plugged", "status": "completed", "tag": "df2173ff-664e-43ca-b7a5-ee5bf4830547"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:36.562721 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-39abd9a7-d3b8-4505-a5e4-5a09717c3cb6 req-c1fd25cf-8a25-4622-b1c5-c6c34498ccbf service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:36.563279 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-39abd9a7-d3b8-4505-a5e4-5a09717c3cb6 req-c1fd25cf-8a25-4622-b1c5-c6c34498ccbf service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:36.576758 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-39abd9a7-d3b8-4505-a5e4-5a09717c3cb6 req-c1fd25cf-8a25-4622-b1c5-c6c34498ccbf service nova] Creating event network-vif-plugged:df2173ff-664e-43ca-b7a5-ee5bf4830547 for instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef on hv-cinder-84330 May 25 17:13:36.581719 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-39abd9a7-d3b8-4505-a5e4-5a09717c3cb6 req-c1fd25cf-8a25-4622-b1c5-c6c34498ccbf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032894 May 25 17:13:36.582513 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 321/617] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:36.641838 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-469e407d-971a-42a6-a242-f747f930affb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:36.643031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-469e407d-971a-42a6-a242-f747f930affb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:36.651194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-469e407d-971a-42a6-a242-f747f930affb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:36.652022 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-469e407d-971a-42a6-a242-f747f930affb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:36.653456 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-469e407d-971a-42a6-a242-f747f930affb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:36.654124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-469e407d-971a-42a6-a242-f747f930affb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:36.942374 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a1a14a2a-ca25-4dd5-97e7-608ad39cef87 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:36.943081 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a1a14a2a-ca25-4dd5-97e7-608ad39cef87 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:36.949881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a1a14a2a-ca25-4dd5-97e7-608ad39cef87 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:36.950341 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a1a14a2a-ca25-4dd5-97e7-608ad39cef87 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:36.951114 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a1a14a2a-ca25-4dd5-97e7-608ad39cef87 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:36.951553 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a1a14a2a-ca25-4dd5-97e7-608ad39cef87 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:37.082328 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-469e407d-971a-42a6-a242-f747f930affb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:37.093988 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a1a14a2a-ca25-4dd5-97e7-608ad39cef87 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:37.095577 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-469e407d-971a-42a6-a242-f747f930affb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1367 microversion: 2.1 time: 0.457587 May 25 17:13:37.096369 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 297/618] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:36 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:37.104781 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a1a14a2a-ca25-4dd5-97e7-608ad39cef87 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1513 microversion: 2.1 time: 0.165364 May 25 17:13:37.110278 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 322/619] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:36 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:37.377844 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-88485133", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8771ee30-f2eb-41ac-813c-a5d3ee111699"}], "security_groups": [{"name": "tempest-securitygroup--1793483572"}], "key_name": "tempest-keypair-1844653568", "user_data": "}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:37.384321 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:37.468422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-8c009e70-036f-4ef8-aec7-e26f76ba50b6 req-62b21c26-3c96-4eed-813f-1eb44d6aa907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475dd99c-12d2-41dc-8a56-c090ad97daa9", "name": "network-vif-deleted", "tag": "7edb7e9c-d195-4fd0-ac49-cecab1f2db8b"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:37.476207 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-8c009e70-036f-4ef8-aec7-e26f76ba50b6 req-62b21c26-3c96-4eed-813f-1eb44d6aa907 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:37.476652 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-8c009e70-036f-4ef8-aec7-e26f76ba50b6 req-62b21c26-3c96-4eed-813f-1eb44d6aa907 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:37.488448 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-8c009e70-036f-4ef8-aec7-e26f76ba50b6 req-62b21c26-3c96-4eed-813f-1eb44d6aa907 service nova] Creating event network-vif-deleted:7edb7e9c-d195-4fd0-ac49-cecab1f2db8b for instance 475dd99c-12d2-41dc-8a56-c090ad97daa9 on hv-cinder-84330 May 25 17:13:37.493515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-8c009e70-036f-4ef8-aec7-e26f76ba50b6 req-62b21c26-3c96-4eed-813f-1eb44d6aa907 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028719 May 25 17:13:37.495226 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 323/620] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:13:37.495514 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] validate_networks() for [('8771ee30-f2eb-41ac-813c-a5d3ee111699', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:13:37.948147 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:13:37.948802 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:13:37.949052 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:13:37.949485 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:13:37.949893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:13:37.958668 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:37.959106 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:37.959892 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:37.960321 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:37.976644 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Getting quotas for project 197671139e6b42069ba82ea9fdf1da40. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:13:37.981007 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Getting quotas for user 41618b0540e64de4b968d5cdc39bea0a and project 197671139e6b42069ba82ea9fdf1da40. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:13:37.992218 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:13:37.994531 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:13:38.040450 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fb90935a-a4cc-4b07-8ed9-4fd666f707ab tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.666869 May 25 17:13:38.041734 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 298/621] 10.222.0.31 () {62 vars in 1187 bytes} [Wed May 25 17:13:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 17:13:38.052483 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b9c24319-64ee-4ca9-a6d8-17b9120f0e73 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:38.053350 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b9c24319-64ee-4ca9-a6d8-17b9120f0e73 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:38.110729 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b9c24319-64ee-4ca9-a6d8-17b9120f0e73 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:38.113953 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-965f76ce-9697-4ebf-b06d-2dba8dc0aae7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:38.115139 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-965f76ce-9697-4ebf-b06d-2dba8dc0aae7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:38.121037 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b9c24319-64ee-4ca9-a6d8-17b9120f0e73 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:38.122606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b9c24319-64ee-4ca9-a6d8-17b9120f0e73 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:38.123663 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b9c24319-64ee-4ca9-a6d8-17b9120f0e73 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1280 microversion: 2.20 time: 0.075819 May 25 17:13:38.124211 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-965f76ce-9697-4ebf-b06d-2dba8dc0aae7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:38.124666 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-965f76ce-9697-4ebf-b06d-2dba8dc0aae7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:38.125353 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 324/622] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:38 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:38.125466 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-965f76ce-9697-4ebf-b06d-2dba8dc0aae7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:38.125898 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-965f76ce-9697-4ebf-b06d-2dba8dc0aae7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:38.129763 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:38.130363 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:38.138455 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:38.139322 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:38.140107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:38.140551 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:38.175990 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:38.176525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:38.177083 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lazy-loading 'fault' on Instance uuid 475dd99c-12d2-41dc-8a56-c090ad97daa9 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:13:38.237720 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483fc20c75df406983982ee5a21b4913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f97d685bab047d8bbcd4c9e804f7d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:38.251741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d4245aab-c09b-4d2c-a0a5-e400c9a3824b tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 200 len: 1308 microversion: 2.1 time: 0.121990 May 25 17:13:38.252608 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 325/623] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:38 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 1308 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:38.326056 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-965f76ce-9697-4ebf-b06d-2dba8dc0aae7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:38.337990 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-965f76ce-9697-4ebf-b06d-2dba8dc0aae7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1367 microversion: 2.1 time: 0.227177 May 25 17:13:38.339070 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 299/624] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:38 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:13:38.602692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-4bab76e2-2260-4365-b8cb-9c9babaed2e7 req-5f4bd00a-f3e4-4faa-b4bf-c97687b6a794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475dd99c-12d2-41dc-8a56-c090ad97daa9", "name": "network-vif-unplugged", "status": "completed", "tag": "7edb7e9c-d195-4fd0-ac49-cecab1f2db8b"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:38.611375 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-4bab76e2-2260-4365-b8cb-9c9babaed2e7 req-5f4bd00a-f3e4-4faa-b4bf-c97687b6a794 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:38.611820 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-4bab76e2-2260-4365-b8cb-9c9babaed2e7 req-5f4bd00a-f3e4-4faa-b4bf-c97687b6a794 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:38.622717 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-4bab76e2-2260-4365-b8cb-9c9babaed2e7 req-5f4bd00a-f3e4-4faa-b4bf-c97687b6a794 service nova] Creating event network-vif-unplugged:7edb7e9c-d195-4fd0-ac49-cecab1f2db8b for instance 475dd99c-12d2-41dc-8a56-c090ad97daa9 on hv-cinder-84330 May 25 17:13:38.627538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-4bab76e2-2260-4365-b8cb-9c9babaed2e7 req-5f4bd00a-f3e4-4faa-b4bf-c97687b6a794 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028580 May 25 17:13:38.628109 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 326/625] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:39.142989 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b1c24057-704e-4977-a0fc-bfcda1a96d47 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:39.143599 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b1c24057-704e-4977-a0fc-bfcda1a96d47 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:39.150730 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b1c24057-704e-4977-a0fc-bfcda1a96d47 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:39.151280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b1c24057-704e-4977-a0fc-bfcda1a96d47 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:39.152060 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b1c24057-704e-4977-a0fc-bfcda1a96d47 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:39.152521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b1c24057-704e-4977-a0fc-bfcda1a96d47 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:39.258142 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b1c24057-704e-4977-a0fc-bfcda1a96d47 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:39.270051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2e15e90a-7e90-4d57-a70d-3ba2bb4425c7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:39.270755 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2e15e90a-7e90-4d57-a70d-3ba2bb4425c7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] [instance: 475dd99c-12d2-41dc-8a56-c090ad97daa9] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:39.281006 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b1c24057-704e-4977-a0fc-bfcda1a96d47 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:39.283632 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2e15e90a-7e90-4d57-a70d-3ba2bb4425c7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:39.284090 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2e15e90a-7e90-4d57-a70d-3ba2bb4425c7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:39.285012 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2e15e90a-7e90-4d57-a70d-3ba2bb4425c7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:39.285813 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2e15e90a-7e90-4d57-a70d-3ba2bb4425c7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:39.288821 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b1c24057-704e-4977-a0fc-bfcda1a96d47 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:39.289974 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b1c24057-704e-4977-a0fc-bfcda1a96d47 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1332 microversion: 2.20 time: 0.150897 May 25 17:13:39.290567 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 300/626] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:39 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1332 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:39.302645 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-2e15e90a-7e90-4d57-a70d-3ba2bb4425c7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] HTTP exception thrown: Instance 475dd99c-12d2-41dc-8a56-c090ad97daa9 could not be found. May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2e15e90a-7e90-4d57-a70d-3ba2bb4425c7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Request method failure captured: May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 HTTP/1.1 May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmNEArOc3-uj0jA-Lyu08Ny0GosCOuFS7lxNQyeT-6uyiIeQKS3PCW8dGaNxNHb5wf72Sn1maSk3hSfNv9nbyXLpTKZ6OHfy-znGH49F8UFfCVt7xFW95ZaFQN7NMVYJBLcmuyNwYb1khSW_JymT22bfvBB-1NxUwR7yLKkXlGsgiTI May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 0f97d685bab047d8bbcd4c9e804f7d82 May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-VolumesSnapshotTestJSON-468727163 May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:13:39.304525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_0f97d685bab047d8bbcd4c9e804f7d82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/0f97d685bab047d8bbcd4c9e804f7d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/0f97d685bab047d8bbcd4c9e804f7d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/0f97d685bab047d8bbcd4c9e804f7d82"}]}] May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-VolumesSnapshotTestJSON-468727163 May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 0f97d685bab047d8bbcd4c9e804f7d82 May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-468727163 May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-VolumesSnapshotTestJSON-468727163-project May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 483fc20c75df406983982ee5a21b4913 May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-VolumesSnapshotTestJSON-468727163-project May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 475dd99c-12d2-41dc-8a56-c090ad97daa9 could not be found. May 25 17:13:39.305880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '475dd99c-12d2-41dc-8a56-c090ad97daa9'} May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475dd99c-12d2-41dc-8a56-c090ad97daa9 could not be found. May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:13:39.307415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475dd99c-12d2-41dc-8a56-c090ad97daa9 could not be found. May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475dd99c-12d2-41dc-8a56-c090ad97daa9 could not be found. May 25 17:13:39.308833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:13:39.310488 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2e15e90a-7e90-4d57-a70d-3ba2bb4425c7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] Returning 404 to user: Instance 475dd99c-12d2-41dc-8a56-c090ad97daa9 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:13:39.310488 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2e15e90a-7e90-4d57-a70d-3ba2bb4425c7 tempest-VolumesSnapshotTestJSON-468727163 tempest-VolumesSnapshotTestJSON-468727163-project] 10.222.0.31 "GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9" status: 404 len: 111 microversion: 2.1 time: 0.040080 May 25 17:13:39.310488 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 327/627] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:39 2022] GET /compute/v2.1/servers/475dd99c-12d2-41dc-8a56-c090ad97daa9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:13:39.356352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8cda811d-6a96-4b42-a6b1-7a3f902e3048 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:39.357086 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8cda811d-6a96-4b42-a6b1-7a3f902e3048 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:39.365872 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cda811d-6a96-4b42-a6b1-7a3f902e3048 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:39.366316 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cda811d-6a96-4b42-a6b1-7a3f902e3048 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:39.367125 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cda811d-6a96-4b42-a6b1-7a3f902e3048 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:39.367554 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cda811d-6a96-4b42-a6b1-7a3f902e3048 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:39.607854 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8cda811d-6a96-4b42-a6b1-7a3f902e3048 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:39.617452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8cda811d-6a96-4b42-a6b1-7a3f902e3048 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1557 microversion: 2.1 time: 0.265437 May 25 17:13:39.618251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 301/628] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:13:39 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1557 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:13:39.636222 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-83dea058-06c7-409e-866a-293f7ef46bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:39.636739 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-83dea058-06c7-409e-866a-293f7ef46bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:39.643684 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-83dea058-06c7-409e-866a-293f7ef46bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:39.644122 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-83dea058-06c7-409e-866a-293f7ef46bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:39.645123 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-83dea058-06c7-409e-866a-293f7ef46bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:39.645562 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-83dea058-06c7-409e-866a-293f7ef46bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:39.730783 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-83dea058-06c7-409e-866a-293f7ef46bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098669 May 25 17:13:39.731462 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 328/629] 10.222.0.31 () {58 vars in 1274 bytes} [Wed May 25 17:13:39 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:40.308027 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ffbcc35d-7806-48f9-b45b-642fece292e8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:40.308626 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ffbcc35d-7806-48f9-b45b-642fece292e8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:40.320875 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ffbcc35d-7806-48f9-b45b-642fece292e8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:40.321336 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ffbcc35d-7806-48f9-b45b-642fece292e8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:40.326809 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ffbcc35d-7806-48f9-b45b-642fece292e8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:40.327721 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ffbcc35d-7806-48f9-b45b-642fece292e8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:40.568389 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ffbcc35d-7806-48f9-b45b-642fece292e8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:40.581136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ffbcc35d-7806-48f9-b45b-642fece292e8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:40.583291 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ffbcc35d-7806-48f9-b45b-642fece292e8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:40.585742 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ffbcc35d-7806-48f9-b45b-642fece292e8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.281527 May 25 17:13:40.586554 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 302/630] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:40 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:40.785937 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-559b9248-90fe-4c41-a7c6-0e77a988533c req-4f49784a-acca-46ec-90f2-8542e8070d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d856fd3d-ee9c-45ec-b4a1-46789378a5ef", "tag": "df2173ff-664e-43ca-b7a5-ee5bf4830547"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:40.798460 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-559b9248-90fe-4c41-a7c6-0e77a988533c req-4f49784a-acca-46ec-90f2-8542e8070d00 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:40.798933 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-559b9248-90fe-4c41-a7c6-0e77a988533c req-4f49784a-acca-46ec-90f2-8542e8070d00 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:40.830823 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-559b9248-90fe-4c41-a7c6-0e77a988533c req-4f49784a-acca-46ec-90f2-8542e8070d00 service nova] Creating event network-changed:df2173ff-664e-43ca-b7a5-ee5bf4830547 for instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef on hv-cinder-84330 May 25 17:13:40.837022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-559b9248-90fe-4c41-a7c6-0e77a988533c req-4f49784a-acca-46ec-90f2-8542e8070d00 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055168 May 25 17:13:40.838355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 329/631] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:41.080520 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-935d0ef1-3cdb-47ec-a0ea-a7d5f321c9b3 req-d50ff6a4-eb1f-4cd2-b9dc-f98afa2c0224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a32d7a-f536-4bc3-8048-cfcb457b2881", "tag": "fc8011bd-f7ca-4b39-81ab-c9bfafbcd234"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:41.098504 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-935d0ef1-3cdb-47ec-a0ea-a7d5f321c9b3 req-d50ff6a4-eb1f-4cd2-b9dc-f98afa2c0224 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:41.099482 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-935d0ef1-3cdb-47ec-a0ea-a7d5f321c9b3 req-d50ff6a4-eb1f-4cd2-b9dc-f98afa2c0224 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:41.114529 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-935d0ef1-3cdb-47ec-a0ea-a7d5f321c9b3 req-d50ff6a4-eb1f-4cd2-b9dc-f98afa2c0224 service nova] Creating event network-changed:fc8011bd-f7ca-4b39-81ab-c9bfafbcd234 for instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 on hv-cinder-84330 May 25 17:13:41.130421 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-935d0ef1-3cdb-47ec-a0ea-a7d5f321c9b3 req-d50ff6a4-eb1f-4cd2-b9dc-f98afa2c0224 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065489 May 25 17:13:41.132496 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 303/632] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:41.606300 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0bc7bc80-2e8b-4e2d-a7e4-d9bce3923ae6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:41.607008 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0bc7bc80-2e8b-4e2d-a7e4-d9bce3923ae6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:41.613771 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0bc7bc80-2e8b-4e2d-a7e4-d9bce3923ae6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:41.614223 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0bc7bc80-2e8b-4e2d-a7e4-d9bce3923ae6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:41.614996 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0bc7bc80-2e8b-4e2d-a7e4-d9bce3923ae6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:41.615428 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0bc7bc80-2e8b-4e2d-a7e4-d9bce3923ae6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:41.753122 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0bc7bc80-2e8b-4e2d-a7e4-d9bce3923ae6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:41.762744 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0bc7bc80-2e8b-4e2d-a7e4-d9bce3923ae6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:41.764380 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0bc7bc80-2e8b-4e2d-a7e4-d9bce3923ae6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:41.765804 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0bc7bc80-2e8b-4e2d-a7e4-d9bce3923ae6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.164747 May 25 17:13:41.766602 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 330/633] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:41 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:42.785527 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-448c9bfc-71a2-40e8-9208-af436f08ccad tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:42.786222 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-448c9bfc-71a2-40e8-9208-af436f08ccad tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:42.794174 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-448c9bfc-71a2-40e8-9208-af436f08ccad tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:42.794626 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-448c9bfc-71a2-40e8-9208-af436f08ccad tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:42.795402 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-448c9bfc-71a2-40e8-9208-af436f08ccad tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:42.795841 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-448c9bfc-71a2-40e8-9208-af436f08ccad tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:43.004638 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-448c9bfc-71a2-40e8-9208-af436f08ccad tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:43.012649 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-448c9bfc-71a2-40e8-9208-af436f08ccad tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:43.014204 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-448c9bfc-71a2-40e8-9208-af436f08ccad tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:43.015287 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-448c9bfc-71a2-40e8-9208-af436f08ccad tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.234112 May 25 17:13:43.015838 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 304/634] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:42 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:44.032455 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-36abed7f-dca2-498b-af81-790f39dd93b7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:44.032991 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-36abed7f-dca2-498b-af81-790f39dd93b7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:44.041343 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-36abed7f-dca2-498b-af81-790f39dd93b7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:44.041795 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-36abed7f-dca2-498b-af81-790f39dd93b7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:44.042569 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-36abed7f-dca2-498b-af81-790f39dd93b7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:44.043002 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-36abed7f-dca2-498b-af81-790f39dd93b7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:44.195653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-36abed7f-dca2-498b-af81-790f39dd93b7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:44.204349 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-36abed7f-dca2-498b-af81-790f39dd93b7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:44.205971 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-36abed7f-dca2-498b-af81-790f39dd93b7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:44.207125 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-36abed7f-dca2-498b-af81-790f39dd93b7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.178504 May 25 17:13:44.208003 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 331/635] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:44 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:45.224978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-be16bc73-c2b0-4c40-b1a0-aecd13e1d40c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:45.225588 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-be16bc73-c2b0-4c40-b1a0-aecd13e1d40c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:45.232893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be16bc73-c2b0-4c40-b1a0-aecd13e1d40c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:45.233347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be16bc73-c2b0-4c40-b1a0-aecd13e1d40c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:45.234115 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be16bc73-c2b0-4c40-b1a0-aecd13e1d40c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:45.234550 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be16bc73-c2b0-4c40-b1a0-aecd13e1d40c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:45.435370 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-be16bc73-c2b0-4c40-b1a0-aecd13e1d40c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:45.445153 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-be16bc73-c2b0-4c40-b1a0-aecd13e1d40c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:45.447537 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-be16bc73-c2b0-4c40-b1a0-aecd13e1d40c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:45.449234 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-be16bc73-c2b0-4c40-b1a0-aecd13e1d40c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.228161 May 25 17:13:45.449977 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 305/636] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:45 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:46.468769 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-eadf0b57-3f78-4ec5-9e41-a163968fb63b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:46.469384 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-eadf0b57-3f78-4ec5-9e41-a163968fb63b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:46.475903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eadf0b57-3f78-4ec5-9e41-a163968fb63b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:46.476361 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eadf0b57-3f78-4ec5-9e41-a163968fb63b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:46.477351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eadf0b57-3f78-4ec5-9e41-a163968fb63b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:46.477857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-eadf0b57-3f78-4ec5-9e41-a163968fb63b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:46.613791 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-eadf0b57-3f78-4ec5-9e41-a163968fb63b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:46.622655 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-eadf0b57-3f78-4ec5-9e41-a163968fb63b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:46.624370 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-eadf0b57-3f78-4ec5-9e41-a163968fb63b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:46.626218 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-eadf0b57-3f78-4ec5-9e41-a163968fb63b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.160824 May 25 17:13:46.626783 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 332/637] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:46 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:47.644564 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-be982fa0-e517-4308-8c07-89763a2358c1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:47.645119 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-be982fa0-e517-4308-8c07-89763a2358c1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:47.652332 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be982fa0-e517-4308-8c07-89763a2358c1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:47.652817 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be982fa0-e517-4308-8c07-89763a2358c1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:47.653583 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be982fa0-e517-4308-8c07-89763a2358c1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:47.654018 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be982fa0-e517-4308-8c07-89763a2358c1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:47.787219 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-be982fa0-e517-4308-8c07-89763a2358c1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:47.796129 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-be982fa0-e517-4308-8c07-89763a2358c1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:47.797650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-be982fa0-e517-4308-8c07-89763a2358c1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:47.798742 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-be982fa0-e517-4308-8c07-89763a2358c1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.158207 May 25 17:13:47.799296 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 306/638] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:47 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:48.818729 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a1e60d43-67f6-45f0-96af-45a72f5ee780 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:48.819416 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a1e60d43-67f6-45f0-96af-45a72f5ee780 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:48.822658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=6 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:48.828327 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a1e60d43-67f6-45f0-96af-45a72f5ee780 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:48.828875 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a1e60d43-67f6-45f0-96af-45a72f5ee780 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:48.829741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a1e60d43-67f6-45f0-96af-45a72f5ee780 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:48.830251 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a1e60d43-67f6-45f0-96af-45a72f5ee780 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:48.959022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a1e60d43-67f6-45f0-96af-45a72f5ee780 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:48.967080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a1e60d43-67f6-45f0-96af-45a72f5ee780 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:48.968578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a1e60d43-67f6-45f0-96af-45a72f5ee780 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:48.969707 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a1e60d43-67f6-45f0-96af-45a72f5ee780 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.155057 May 25 17:13:48.970272 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 333/639] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:48 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:49.485335 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-9a7b9e37-c2ed-4067-a8f7-21c4d834aaa8 req-e4a9d3ca-6c38-46f3-b400-e57dba06d7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a32d7a-f536-4bc3-8048-cfcb457b2881", "name": "network-vif-plugged", "status": "completed", "tag": "fc8011bd-f7ca-4b39-81ab-c9bfafbcd234"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:49.488926 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:49.489790 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:49.497268 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-9a7b9e37-c2ed-4067-a8f7-21c4d834aaa8 req-e4a9d3ca-6c38-46f3-b400-e57dba06d7f3 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:49.497735 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-9a7b9e37-c2ed-4067-a8f7-21c4d834aaa8 req-e4a9d3ca-6c38-46f3-b400-e57dba06d7f3 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:49.510297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-9a7b9e37-c2ed-4067-a8f7-21c4d834aaa8 req-e4a9d3ca-6c38-46f3-b400-e57dba06d7f3 service nova] Creating event network-vif-plugged:fc8011bd-f7ca-4b39-81ab-c9bfafbcd234 for instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 on hv-cinder-84330 May 25 17:13:49.515242 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-9a7b9e37-c2ed-4067-a8f7-21c4d834aaa8 req-e4a9d3ca-6c38-46f3-b400-e57dba06d7f3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033670 May 25 17:13:49.516041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 307/640] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:13:49.987474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1c0b044b-812b-4279-99ec-55ff9d91e779 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:49.988021 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1c0b044b-812b-4279-99ec-55ff9d91e779 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:49.994702 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c0b044b-812b-4279-99ec-55ff9d91e779 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:49.995153 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c0b044b-812b-4279-99ec-55ff9d91e779 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:49.995951 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c0b044b-812b-4279-99ec-55ff9d91e779 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:49.996396 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1c0b044b-812b-4279-99ec-55ff9d91e779 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:50.128153 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1c0b044b-812b-4279-99ec-55ff9d91e779 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:50.137084 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1c0b044b-812b-4279-99ec-55ff9d91e779 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:50.138634 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1c0b044b-812b-4279-99ec-55ff9d91e779 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:50.139743 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1c0b044b-812b-4279-99ec-55ff9d91e779 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.156322 May 25 17:13:50.140302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 334/641] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:49 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:51.158915 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-82737609-4ca7-4b97-811a-87ef533d6822 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:51.159528 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-82737609-4ca7-4b97-811a-87ef533d6822 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:51.167409 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82737609-4ca7-4b97-811a-87ef533d6822 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:51.167856 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82737609-4ca7-4b97-811a-87ef533d6822 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:51.168622 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82737609-4ca7-4b97-811a-87ef533d6822 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:51.169330 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82737609-4ca7-4b97-811a-87ef533d6822 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:51.305459 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-82737609-4ca7-4b97-811a-87ef533d6822 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:51.315081 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-82737609-4ca7-4b97-811a-87ef533d6822 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:51.316596 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-82737609-4ca7-4b97-811a-87ef533d6822 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:51.317739 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-82737609-4ca7-4b97-811a-87ef533d6822 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.163130 May 25 17:13:51.318297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 308/642] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:51 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:52.336368 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-47a9eb26-bc11-4311-8acc-38ae55c2cdc3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:52.337583 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-47a9eb26-bc11-4311-8acc-38ae55c2cdc3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:52.343836 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-47a9eb26-bc11-4311-8acc-38ae55c2cdc3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:52.344289 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-47a9eb26-bc11-4311-8acc-38ae55c2cdc3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:52.345088 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-47a9eb26-bc11-4311-8acc-38ae55c2cdc3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:52.345532 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-47a9eb26-bc11-4311-8acc-38ae55c2cdc3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:52.495061 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-47a9eb26-bc11-4311-8acc-38ae55c2cdc3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:52.507620 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-47a9eb26-bc11-4311-8acc-38ae55c2cdc3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:52.509952 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-47a9eb26-bc11-4311-8acc-38ae55c2cdc3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:52.511069 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-47a9eb26-bc11-4311-8acc-38ae55c2cdc3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1406 microversion: 2.20 time: 0.178504 May 25 17:13:52.511671 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 335/643] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:52 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:53.529493 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-083be51c-442c-461d-bdd1-66d4895ef4ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:53.531128 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-083be51c-442c-461d-bdd1-66d4895ef4ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:53.537560 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-083be51c-442c-461d-bdd1-66d4895ef4ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:53.538007 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-083be51c-442c-461d-bdd1-66d4895ef4ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:53.538766 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-083be51c-442c-461d-bdd1-66d4895ef4ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:53.539197 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-083be51c-442c-461d-bdd1-66d4895ef4ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:53.686047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-083be51c-442c-461d-bdd1-66d4895ef4ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:53.689888 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:53.695462 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-083be51c-442c-461d-bdd1-66d4895ef4ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:53.697632 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-083be51c-442c-461d-bdd1-66d4895ef4ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:13:53.698855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-083be51c-442c-461d-bdd1-66d4895ef4ce tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1599 microversion: 2.20 time: 0.173370 May 25 17:13:53.699417 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 309/644] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:13:53 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:13:53.717488 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8dba716a-3018-4ebb-af01-db0886a34b62 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:13:53.718027 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8dba716a-3018-4ebb-af01-db0886a34b62 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:13:53.724551 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8dba716a-3018-4ebb-af01-db0886a34b62 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:53.725104 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8dba716a-3018-4ebb-af01-db0886a34b62 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:53.725880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8dba716a-3018-4ebb-af01-db0886a34b62 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:53.726314 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8dba716a-3018-4ebb-af01-db0886a34b62 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:53.810826 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8dba716a-3018-4ebb-af01-db0886a34b62 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097417 May 25 17:13:53.811428 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 336/645] 10.222.0.31 () {60 vars in 1315 bytes} [Wed May 25 17:13:53 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:13:54.742616 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-bf515ec2-e27d-4770-9ec8-8d989ef02efe req-feef6797-e148-4b7d-991e-92af7223a33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a32d7a-f536-4bc3-8048-cfcb457b2881", "tag": "fc8011bd-f7ca-4b39-81ab-c9bfafbcd234"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:13:54.752072 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-bf515ec2-e27d-4770-9ec8-8d989ef02efe req-feef6797-e148-4b7d-991e-92af7223a33f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:13:54.752524 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-bf515ec2-e27d-4770-9ec8-8d989ef02efe req-feef6797-e148-4b7d-991e-92af7223a33f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:13:54.768113 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-bf515ec2-e27d-4770-9ec8-8d989ef02efe req-feef6797-e148-4b7d-991e-92af7223a33f service nova] Creating event network-changed:fc8011bd-f7ca-4b39-81ab-c9bfafbcd234 for instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 on hv-cinder-84330 May 25 17:13:54.773301 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-bf515ec2-e27d-4770-9ec8-8d989ef02efe req-feef6797-e148-4b7d-991e-92af7223a33f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034609 May 25 17:13:54.773897 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 310/646] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:05.849692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=38 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:05.850437 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:05.855311 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6fcfb182-6b38-434c-b5ef-bcf4b0cf03f3 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:05.856533 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6fcfb182-6b38-434c-b5ef-bcf4b0cf03f3 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:05.863533 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6fcfb182-6b38-434c-b5ef-bcf4b0cf03f3 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:05.863929 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6fcfb182-6b38-434c-b5ef-bcf4b0cf03f3 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:05.864730 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6fcfb182-6b38-434c-b5ef-bcf4b0cf03f3 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:05.865174 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6fcfb182-6b38-434c-b5ef-bcf4b0cf03f3 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:05.898933 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6fcfb182-6b38-434c-b5ef-bcf4b0cf03f3 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050530 May 25 17:14:05.899522 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 337/647] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:14:05 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 17:14:05.962990 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:05.965125 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:05.970051 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fd3644e0-1265-49ee-98e5-2cf607368c3d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:05.970661 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fd3644e0-1265-49ee-98e5-2cf607368c3d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:05.979671 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd3644e0-1265-49ee-98e5-2cf607368c3d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:05.980112 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd3644e0-1265-49ee-98e5-2cf607368c3d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:05.981120 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd3644e0-1265-49ee-98e5-2cf607368c3d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:05.981720 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd3644e0-1265-49ee-98e5-2cf607368c3d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:06.011043 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fd3644e0-1265-49ee-98e5-2cf607368c3d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:14:06.098383 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fd3644e0-1265-49ee-98e5-2cf607368c3d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 204 len: 0 microversion: 2.1 time: 0.137313 May 25 17:14:06.102340 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 311/648] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:14:05 2022] DELETE /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:14:06.112814 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-36afc41a-9c80-4afc-b724-613ef1fba3a7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:06.113432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-36afc41a-9c80-4afc-b724-613ef1fba3a7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:06.123378 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-36afc41a-9c80-4afc-b724-613ef1fba3a7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:06.124334 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-36afc41a-9c80-4afc-b724-613ef1fba3a7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:06.125439 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-36afc41a-9c80-4afc-b724-613ef1fba3a7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:06.126086 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-36afc41a-9c80-4afc-b724-613ef1fba3a7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:06.338695 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-36afc41a-9c80-4afc-b724-613ef1fba3a7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:06.347677 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-36afc41a-9c80-4afc-b724-613ef1fba3a7 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1672 microversion: 2.1 time: 0.239812 May 25 17:14:06.348935 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 338/649] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:06 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1672 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:07.366124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f0160a21-f665-4c50-994a-6bbf4f2eb8d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:07.366822 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f0160a21-f665-4c50-994a-6bbf4f2eb8d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:07.373882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f0160a21-f665-4c50-994a-6bbf4f2eb8d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:07.374553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f0160a21-f665-4c50-994a-6bbf4f2eb8d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:07.375498 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f0160a21-f665-4c50-994a-6bbf4f2eb8d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:07.375932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f0160a21-f665-4c50-994a-6bbf4f2eb8d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:07.519056 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f0160a21-f665-4c50-994a-6bbf4f2eb8d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:07.528050 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f0160a21-f665-4c50-994a-6bbf4f2eb8d5 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1672 microversion: 2.1 time: 0.166138 May 25 17:14:07.528642 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 312/650] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:07 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:08.546333 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-86a22b9d-0b56-4c15-b1f0-3e292fb4e7b4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:08.546929 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-86a22b9d-0b56-4c15-b1f0-3e292fb4e7b4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:08.553633 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-86a22b9d-0b56-4c15-b1f0-3e292fb4e7b4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:08.558712 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-86a22b9d-0b56-4c15-b1f0-3e292fb4e7b4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:08.559749 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-86a22b9d-0b56-4c15-b1f0-3e292fb4e7b4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:08.560377 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-86a22b9d-0b56-4c15-b1f0-3e292fb4e7b4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:09.454904 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-86a22b9d-0b56-4c15-b1f0-3e292fb4e7b4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:09.476976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-86a22b9d-0b56-4c15-b1f0-3e292fb4e7b4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1672 microversion: 2.1 time: 0.932969 May 25 17:14:09.479260 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 339/651] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:08 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1672 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:10.167734 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-ab86a19c-b6bd-4a98-8d62-49dce794056d req-29f5362a-fd74-40cb-bbf1-eae969b43bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecb9b07-e50d-4926-b95d-af40c6093d83", "name": "network-vif-deleted", "tag": "9a8368c6-6150-48dd-9dcf-3a607cd09518"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:10.226595 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-ab86a19c-b6bd-4a98-8d62-49dce794056d req-29f5362a-fd74-40cb-bbf1-eae969b43bbe service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:10.227450 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-ab86a19c-b6bd-4a98-8d62-49dce794056d req-29f5362a-fd74-40cb-bbf1-eae969b43bbe service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:10.248401 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-ab86a19c-b6bd-4a98-8d62-49dce794056d req-29f5362a-fd74-40cb-bbf1-eae969b43bbe service nova] Creating event network-vif-deleted:9a8368c6-6150-48dd-9dcf-3a607cd09518 for instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 on hv-cinder-84330 May 25 17:14:10.257991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-ab86a19c-b6bd-4a98-8d62-49dce794056d req-29f5362a-fd74-40cb-bbf1-eae969b43bbe service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095966 May 25 17:14:10.261044 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 313/652] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:10.500255 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:10.500971 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:10.510819 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:10.511272 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:10.517502 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:10.518215 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:10.578924 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:10.578924 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:10.579406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lazy-loading 'fault' on Instance uuid 5ecb9b07-e50d-4926-b95d-af40c6093d83 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:14:10.688272 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:10.705996 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9cfcb9fa-57bb-4693-bf22-48c9019a3a83 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 200 len: 1328 microversion: 2.1 time: 0.208558 May 25 17:14:10.710870 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 340/653] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:10 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 1328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:11.734996 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-082c8112-0c1f-4dfe-9dd1-418f893d6c41 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:11.735766 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-082c8112-0c1f-4dfe-9dd1-418f893d6c41 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:11.748813 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-082c8112-0c1f-4dfe-9dd1-418f893d6c41 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:11.753400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-082c8112-0c1f-4dfe-9dd1-418f893d6c41 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:11.755011 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-082c8112-0c1f-4dfe-9dd1-418f893d6c41 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:11.755607 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-082c8112-0c1f-4dfe-9dd1-418f893d6c41 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:11.791822 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-082c8112-0c1f-4dfe-9dd1-418f893d6c41 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] HTTP exception thrown: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-082c8112-0c1f-4dfe-9dd1-418f893d6c41 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Request method failure captured: May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 HTTP/1.1 May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmK8cP-YJ2I-M6eAL0PTEL4lqAgq3m8brrJjvLDl_zivtWKyCbiLzYig9f-8JUqBPjUQIyQDyez1qaSYf09VJ_ieMgWjJdOZQQNkAjyh-VGHis4RtsJjR3_preG7JFpusOQmKbpxyaK2Be0BU7XL5ztyyS36-9NFfPzad9VPzSl4rSQ May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:14:11.796252 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_7691c75f7a3448e38a99489d3df21925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}] May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeTestJSON-328720228 May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeTestJSON-328720228-project May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 902f574061e64236ae8d6df08093c8e2 May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeTestJSON-328720228-project May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:14:11.797899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '5ecb9b07-e50d-4926-b95d-af40c6093d83'} May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:14:11.798791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:14:11.800277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:11.806788 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-082c8112-0c1f-4dfe-9dd1-418f893d6c41 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Returning 404 to user: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:14:11.813002 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-082c8112-0c1f-4dfe-9dd1-418f893d6c41 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 404 len: 111 microversion: 2.1 time: 0.083030 May 25 17:14:11.814643 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 314/654] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:11 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:14:11.827660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0e7dc896-c759-43d3-befb-c05f82c5c19f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '.version_select at 0x7f3d4e0d70d0>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:11.869096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0e7dc896-c759-43d3-befb-c05f82c5c19f tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1443351293" status: 202 len: 0 microversion: 2.1 time: 0.048798 May 25 17:14:11.872966 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 341/655] 10.222.0.31 () {58 vars in 1220 bytes} [Wed May 25 17:14:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1443351293 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:14:12.942982 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9897e3f2-98dc-41e4-b324-4cc7e5da1ece tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'create', calling method: .version_select at 0x7f3d4e9900d0>, body: {"keypair": {"name": "tempest-keypair-1451147041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/PafbWJCNrxXXnR3FhqcXjC9GJ+Km85wf7FOX8iPLmYlLjQ1MVYvb+faUxBehmW4LC6WpeWEI/rHOZ6L5T84XjmGGqbExvlewuRT4Jx6YJOAQPLPBO/Ulapm3V0yPBFA=="}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:12.996327 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-9897e3f2-98dc-41e4-b324-4cc7e5da1ece tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Getting quotas for project 7691c75f7a3448e38a99489d3df21925. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:14:13.002720 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-9897e3f2-98dc-41e4-b324-4cc7e5da1ece tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Getting quotas for user 902f574061e64236ae8d6df08093c8e2 and project 7691c75f7a3448e38a99489d3df21925. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:14:13.040962 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9897e3f2-98dc-41e4-b324-4cc7e5da1ece tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105992 May 25 17:14:13.061748 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 315/656] 10.222.0.31 () {60 vars in 1158 bytes} [Wed May 25 17:14:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 25 17:14:14.143076 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2f17a6c6-8e7f-44af-a69e-c3aa44b6442b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:14.144351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2f17a6c6-8e7f-44af-a69e-c3aa44b6442b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:14.154790 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2f17a6c6-8e7f-44af-a69e-c3aa44b6442b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:14.155558 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2f17a6c6-8e7f-44af-a69e-c3aa44b6442b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:14.156558 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2f17a6c6-8e7f-44af-a69e-c3aa44b6442b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:14.157192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2f17a6c6-8e7f-44af-a69e-c3aa44b6442b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:14.284854 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-2f17a6c6-8e7f-44af-a69e-c3aa44b6442b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lazy-loading 'services' on Instance uuid 377df57f-c46c-4107-99f6-3d8ce8707e39 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:14:14.394902 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2f17a6c6-8e7f-44af-a69e-c3aa44b6442b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "DELETE /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments/fa48b200-1aa3-4e4b-b165-cc159649fe16" status: 202 len: 0 microversion: 2.1 time: 0.261955 May 25 17:14:14.395605 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 342/657] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:14:14 2022] DELETE /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments/fa48b200-1aa3-4e4b-b165-cc159649fe16 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:14:14.404194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-75f6b753-a240-4895-b933-df29b334293a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:14.405158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-75f6b753-a240-4895-b933-df29b334293a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:14.433380 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75f6b753-a240-4895-b933-df29b334293a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:14.435820 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75f6b753-a240-4895-b933-df29b334293a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:14.437297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75f6b753-a240-4895-b933-df29b334293a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:14.437919 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75f6b753-a240-4895-b933-df29b334293a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:14.481615 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-75f6b753-a240-4895-b933-df29b334293a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080069 May 25 17:14:14.482517 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 316/658] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:14:14 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:15.026580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1065f1e8-9111-4125-9290-29b021d4ee25 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Action: 'create', calling method: .version_select at 0x7f3d4e0bd8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-500528931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlLuPRdmjh8xiE9NaIxzCf00lnWtLPuRmdab5/bbsVzPVMBTBsIodXxihOHKVHMLNtqJ5ZPM5AV98Mvbl6xZoyh3QcwqUUHdebW2uagaqcfIhllrjPcJOgKt7PhwjsQEg=="}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:15.041827 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-1065f1e8-9111-4125-9290-29b021d4ee25 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Getting quotas for project df9bc8d103cf40e1b8d984f1947e7c5d. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:14:15.046265 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-1065f1e8-9111-4125-9290-29b021d4ee25 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Getting quotas for user 47642301725e4023aba48b2a3a64d5b9 and project df9bc8d103cf40e1b8d984f1947e7c5d. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:14:15.078482 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1065f1e8-9111-4125-9290-29b021d4ee25 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.203279 May 25 17:14:15.080341 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 343/659] 10.222.0.31 () {60 vars in 1158 bytes} [Wed May 25 17:14:14 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:15.341277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1197397264", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d76a1c5f-4c89-4d32-84e7-0dba2627dce6"}], "security_groups": [{"name": "tempest-securitygroup--1312924994"}], "key_name": "tempest-keypair-1451147041", "user_data": "}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:15.497008 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-25e5dd5b-22e0-43ad-97d9-ddfd84a7c889 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:15.498475 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-25e5dd5b-22e0-43ad-97d9-ddfd84a7c889 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:15.507207 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-25e5dd5b-22e0-43ad-97d9-ddfd84a7c889 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:15.507669 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-25e5dd5b-22e0-43ad-97d9-ddfd84a7c889 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:15.508602 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-25e5dd5b-22e0-43ad-97d9-ddfd84a7c889 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:15.509665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-25e5dd5b-22e0-43ad-97d9-ddfd84a7c889 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:15.550502 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-25e5dd5b-22e0-43ad-97d9-ddfd84a7c889 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061113 May 25 17:14:15.551978 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 344/660] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:14:15 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 17:14:15.625331 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6f4c6322-9c12-4f95-b5c0-67102bdca209 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:15.625826 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6f4c6322-9c12-4f95-b5c0-67102bdca209 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:15.632099 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6f4c6322-9c12-4f95-b5c0-67102bdca209 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:15.632544 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6f4c6322-9c12-4f95-b5c0-67102bdca209 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:15.633339 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6f4c6322-9c12-4f95-b5c0-67102bdca209 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:15.634345 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6f4c6322-9c12-4f95-b5c0-67102bdca209 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:15.640892 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] validate_networks() for [('d76a1c5f-4c89-4d32-84e7-0dba2627dce6', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:14:15.661074 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6f4c6322-9c12-4f95-b5c0-67102bdca209 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:14:15.754585 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6f4c6322-9c12-4f95-b5c0-67102bdca209 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "DELETE /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 204 len: 0 microversion: 2.1 time: 0.132303 May 25 17:14:15.755396 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 345/661] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:14:15 2022] DELETE /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 17:14:15.767035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-aa3de0df-f265-4c39-adb0-55e77b0ce28f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:15.767752 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-aa3de0df-f265-4c39-adb0-55e77b0ce28f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:15.774311 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aa3de0df-f265-4c39-adb0-55e77b0ce28f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:15.775790 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aa3de0df-f265-4c39-adb0-55e77b0ce28f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:15.776836 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aa3de0df-f265-4c39-adb0-55e77b0ce28f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:15.777430 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aa3de0df-f265-4c39-adb0-55e77b0ce28f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:15.976910 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-aa3de0df-f265-4c39-adb0-55e77b0ce28f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:15.985569 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-aa3de0df-f265-4c39-adb0-55e77b0ce28f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1690 microversion: 2.1 time: 0.224836 May 25 17:14:15.986891 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 346/662] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:15 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:16.169510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:14:16.169948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:14:16.170413 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:14:16.170824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:14:16.171253 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:14:16.187966 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:16.188891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:16.189693 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:16.190978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:16.214732 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Getting quotas for project 7691c75f7a3448e38a99489d3df21925. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:14:16.219083 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Getting quotas for user 902f574061e64236ae8d6df08093c8e2 and project 7691c75f7a3448e38a99489d3df21925. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:14:16.230729 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:14:16.233149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:14:16.286887 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-54ff8a76-3ed8-4ac8-a85d-0f8b5e679cff tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.951435 May 25 17:14:16.293442 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 317/663] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:14:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:14:16.298456 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6dd6a5d9-56a4-4452-a4da-5cd4a38a4d44 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:16.299402 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6dd6a5d9-56a4-4452-a4da-5cd4a38a4d44 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:16.395607 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6dd6a5d9-56a4-4452-a4da-5cd4a38a4d44 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:16.404289 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6dd6a5d9-56a4-4452-a4da-5cd4a38a4d44 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1238 microversion: 2.1 time: 0.109646 May 25 17:14:16.405018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 347/664] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:16 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1238 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:17.007195 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-96059aa9-aa86-4562-9a6c-3ea4260951fc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:17.008210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-96059aa9-aa86-4562-9a6c-3ea4260951fc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:17.017927 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-96059aa9-aa86-4562-9a6c-3ea4260951fc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:17.018721 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-96059aa9-aa86-4562-9a6c-3ea4260951fc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:17.019791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-96059aa9-aa86-4562-9a6c-3ea4260951fc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:17.020572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-96059aa9-aa86-4562-9a6c-3ea4260951fc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:17.193387 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-96059aa9-aa86-4562-9a6c-3ea4260951fc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:17.202177 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-96059aa9-aa86-4562-9a6c-3ea4260951fc tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1690 microversion: 2.1 time: 0.200096 May 25 17:14:17.211931 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 318/665] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:17 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:17.504815 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a6ab419f-e9de-4487-b1de-2e2a7bdfbc13 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:17.505611 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a6ab419f-e9de-4487-b1de-2e2a7bdfbc13 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:17.515769 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a6ab419f-e9de-4487-b1de-2e2a7bdfbc13 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:17.516489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a6ab419f-e9de-4487-b1de-2e2a7bdfbc13 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:17.517657 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a6ab419f-e9de-4487-b1de-2e2a7bdfbc13 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:17.518244 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a6ab419f-e9de-4487-b1de-2e2a7bdfbc13 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:17.613049 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a6ab419f-e9de-4487-b1de-2e2a7bdfbc13 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:17.625852 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a6ab419f-e9de-4487-b1de-2e2a7bdfbc13 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1242 microversion: 2.1 time: 0.208398 May 25 17:14:17.628339 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 348/666] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:17 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1242 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:18.226510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a20ec9d9-9d5f-4d6c-afba-b9cf49ca26d6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:18.227519 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a20ec9d9-9d5f-4d6c-afba-b9cf49ca26d6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:18.236418 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a20ec9d9-9d5f-4d6c-afba-b9cf49ca26d6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:18.237202 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a20ec9d9-9d5f-4d6c-afba-b9cf49ca26d6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:18.238070 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a20ec9d9-9d5f-4d6c-afba-b9cf49ca26d6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:18.238513 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a20ec9d9-9d5f-4d6c-afba-b9cf49ca26d6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:18.385872 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a20ec9d9-9d5f-4d6c-afba-b9cf49ca26d6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:18.393677 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a20ec9d9-9d5f-4d6c-afba-b9cf49ca26d6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1690 microversion: 2.1 time: 0.177918 May 25 17:14:18.394258 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 319/667] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:18 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:18.643560 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a21ac51e-dc92-42fb-a9f4-4157bc976508 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:18.644606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a21ac51e-dc92-42fb-a9f4-4157bc976508 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:18.651545 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a21ac51e-dc92-42fb-a9f4-4157bc976508 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:18.652004 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a21ac51e-dc92-42fb-a9f4-4157bc976508 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:18.652812 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a21ac51e-dc92-42fb-a9f4-4157bc976508 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:18.653255 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a21ac51e-dc92-42fb-a9f4-4157bc976508 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:18.720264 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a21ac51e-dc92-42fb-a9f4-4157bc976508 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:18.728365 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a21ac51e-dc92-42fb-a9f4-4157bc976508 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1242 microversion: 2.1 time: 0.088023 May 25 17:14:18.728954 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 349/668] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:18 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:19.411283 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7709eba8-ccd5-469e-86a0-6f9e8fff4d4b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:19.411978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7709eba8-ccd5-469e-86a0-6f9e8fff4d4b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:19.419788 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7709eba8-ccd5-469e-86a0-6f9e8fff4d4b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:19.420238 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7709eba8-ccd5-469e-86a0-6f9e8fff4d4b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:19.421038 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7709eba8-ccd5-469e-86a0-6f9e8fff4d4b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:19.421471 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7709eba8-ccd5-469e-86a0-6f9e8fff4d4b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:19.567617 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7709eba8-ccd5-469e-86a0-6f9e8fff4d4b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:19.578232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7709eba8-ccd5-469e-86a0-6f9e8fff4d4b tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1690 microversion: 2.1 time: 0.171346 May 25 17:14:19.579169 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 320/669] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:19 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:19.748526 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-85265dd0-7f50-4b95-9d65-c78aebd39d00 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:19.749153 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-85265dd0-7f50-4b95-9d65-c78aebd39d00 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:19.755634 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85265dd0-7f50-4b95-9d65-c78aebd39d00 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:19.756088 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85265dd0-7f50-4b95-9d65-c78aebd39d00 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:19.756895 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85265dd0-7f50-4b95-9d65-c78aebd39d00 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:19.757339 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-85265dd0-7f50-4b95-9d65-c78aebd39d00 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:19.822913 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-85265dd0-7f50-4b95-9d65-c78aebd39d00 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:19.830352 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-85265dd0-7f50-4b95-9d65-c78aebd39d00 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1290 microversion: 2.1 time: 0.085927 May 25 17:14:19.830919 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 350/670] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:19 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:20.596890 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a183db80-bfc3-466b-b9d4-0c328ea24f87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:20.597412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a183db80-bfc3-466b-b9d4-0c328ea24f87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:20.604498 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a183db80-bfc3-466b-b9d4-0c328ea24f87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:20.604977 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a183db80-bfc3-466b-b9d4-0c328ea24f87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:20.605751 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a183db80-bfc3-466b-b9d4-0c328ea24f87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:20.606191 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a183db80-bfc3-466b-b9d4-0c328ea24f87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:20.848475 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a7522a90-08e0-4415-ad2d-2893809a299c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:20.849084 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a7522a90-08e0-4415-ad2d-2893809a299c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:20.857038 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a7522a90-08e0-4415-ad2d-2893809a299c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:20.857494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a7522a90-08e0-4415-ad2d-2893809a299c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:20.858277 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a7522a90-08e0-4415-ad2d-2893809a299c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:20.858865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a7522a90-08e0-4415-ad2d-2893809a299c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:20.904423 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a183db80-bfc3-466b-b9d4-0c328ea24f87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:20.912370 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a183db80-bfc3-466b-b9d4-0c328ea24f87 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1690 microversion: 2.1 time: 0.319430 May 25 17:14:20.932468 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a7522a90-08e0-4415-ad2d-2893809a299c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:20.934591 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 321/671] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:20 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1690 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:20.945655 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a7522a90-08e0-4415-ad2d-2893809a299c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1296 microversion: 2.1 time: 0.101943 May 25 17:14:20.946752 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 351/672] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:20 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:21.657449 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-39c33304-0a06-495d-99ee-7d34f89be2a1 req-b6069aa2-077c-4f4a-a701-1ab814fd1f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377df57f-c46c-4107-99f6-3d8ce8707e39", "name": "network-vif-deleted", "tag": "9f418fcd-8e98-4ba1-96ee-1e27e32eb165"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:21.685907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-39c33304-0a06-495d-99ee-7d34f89be2a1 req-b6069aa2-077c-4f4a-a701-1ab814fd1f52 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:21.687555 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-39c33304-0a06-495d-99ee-7d34f89be2a1 req-b6069aa2-077c-4f4a-a701-1ab814fd1f52 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:21.710415 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-39c33304-0a06-495d-99ee-7d34f89be2a1 req-b6069aa2-077c-4f4a-a701-1ab814fd1f52 service nova] Creating event network-vif-deleted:9f418fcd-8e98-4ba1-96ee-1e27e32eb165 for instance 377df57f-c46c-4107-99f6-3d8ce8707e39 on hv-cinder-84330 May 25 17:14:21.724171 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-39c33304-0a06-495d-99ee-7d34f89be2a1 req-b6069aa2-077c-4f4a-a701-1ab814fd1f52 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074028 May 25 17:14:21.725161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 322/673] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:21.936191 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:21.938064 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:21.946039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:21.947124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:21.948026 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:21.948698 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:21.964799 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-729b3d1f-b14f-4a86-88aa-3aa4011ecca4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:21.965739 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-729b3d1f-b14f-4a86-88aa-3aa4011ecca4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:21.972642 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-729b3d1f-b14f-4a86-88aa-3aa4011ecca4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:21.973103 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-729b3d1f-b14f-4a86-88aa-3aa4011ecca4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:21.974410 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-729b3d1f-b14f-4a86-88aa-3aa4011ecca4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:21.974994 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-729b3d1f-b14f-4a86-88aa-3aa4011ecca4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:21.988616 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:21.989262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:21.989825 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lazy-loading 'fault' on Instance uuid 377df57f-c46c-4107-99f6-3d8ce8707e39 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:14:22.041496 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:22.050125 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-db85f1c6-4f99-4089-b695-3447607c4b9a tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 200 len: 1334 microversion: 2.1 time: 0.120255 May 25 17:14:22.050699 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 352/674] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:21 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 1334 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:22.199680 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-729b3d1f-b14f-4a86-88aa-3aa4011ecca4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:22.214147 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-729b3d1f-b14f-4a86-88aa-3aa4011ecca4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1364 microversion: 2.1 time: 0.254371 May 25 17:14:22.215486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 323/675] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:21 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:23.068197 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8faf1e16-4efe-46e2-96e2-0b35ecbfd932 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:23.068921 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8faf1e16-4efe-46e2-96e2-0b35ecbfd932 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 377df57f-c46c-4107-99f6-3d8ce8707e39] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:23.075406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8faf1e16-4efe-46e2-96e2-0b35ecbfd932 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:23.075850 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8faf1e16-4efe-46e2-96e2-0b35ecbfd932 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:23.076617 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8faf1e16-4efe-46e2-96e2-0b35ecbfd932 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:23.077070 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8faf1e16-4efe-46e2-96e2-0b35ecbfd932 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:23.090335 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-8faf1e16-4efe-46e2-96e2-0b35ecbfd932 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] HTTP exception thrown: Instance 377df57f-c46c-4107-99f6-3d8ce8707e39 could not be found. May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8faf1e16-4efe-46e2-96e2-0b35ecbfd932 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Request method failure captured: May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 HTTP/1.1 May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLGYNd6G28K1F5Vwuevv8bNAGGyG1KQn063AvRNDkhQrhv_VbNEELILAkCaqLFEwEvi0Dvqfjkudz0zR6iHLoRxopgyicuFaijxVda3PK2EFG_6MHUTTsVLuxNFtbXb3F8H7RaOoUvDqTOonq2st05ntld3RmPG6CBG3ac_shdb1ug May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 8c297ec7b46943f594b67c95479f1f7c May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:14:23.091944 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/8c297ec7b46943f594b67c95479f1f7c"}]}] May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 8c297ec7b46943f594b67c95479f1f7c May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-ServerRescueNegativeTestJSON-122117092-project May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3f51c03f7fe54451b49ddb32fc337b98 May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-122117092-project May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 377df57f-c46c-4107-99f6-3d8ce8707e39 could not be found. May 25 17:14:23.093648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '377df57f-c46c-4107-99f6-3d8ce8707e39'} May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377df57f-c46c-4107-99f6-3d8ce8707e39 could not be found. May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:14:23.095360 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377df57f-c46c-4107-99f6-3d8ce8707e39 could not be found. May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377df57f-c46c-4107-99f6-3d8ce8707e39 could not be found. May 25 17:14:23.096872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:23.098158 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8faf1e16-4efe-46e2-96e2-0b35ecbfd932 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Returning 404 to user: Instance 377df57f-c46c-4107-99f6-3d8ce8707e39 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:14:23.098158 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8faf1e16-4efe-46e2-96e2-0b35ecbfd932 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39" status: 404 len: 111 microversion: 2.1 time: 0.029353 May 25 17:14:23.098158 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 353/676] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:23 2022] GET /compute/v2.1/servers/377df57f-c46c-4107-99f6-3d8ce8707e39 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:14:23.102075 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8f47efd7-aa33-4797-9712-b6c5c8e7886d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '.version_select at 0x7f3d4e88d430>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:23.121810 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8f47efd7-aa33-4797-9712-b6c5c8e7886d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-799155635" status: 202 len: 0 microversion: 2.1 time: 0.023388 May 25 17:14:23.122392 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 324/677] 10.222.0.31 () {58 vars in 1217 bytes} [Wed May 25 17:14:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-799155635 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:14:23.232527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f95fbc34-e100-4e93-971e-be6af5b4185c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:23.233484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f95fbc34-e100-4e93-971e-be6af5b4185c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:23.242177 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f95fbc34-e100-4e93-971e-be6af5b4185c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:23.242810 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f95fbc34-e100-4e93-971e-be6af5b4185c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:23.244889 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f95fbc34-e100-4e93-971e-be6af5b4185c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:23.245715 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f95fbc34-e100-4e93-971e-be6af5b4185c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:23.251071 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:23.408225 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f95fbc34-e100-4e93-971e-be6af5b4185c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:23.416833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f95fbc34-e100-4e93-971e-be6af5b4185c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1364 microversion: 2.1 time: 0.189182 May 25 17:14:23.417412 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 354/678] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:23 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:23.742743 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-3d62d4ee-78d3-473f-bbd1-50e7f00df7f0 req-97fc8b92-7fe3-47b3-a640-6a7dffd85de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3259a826-9d68-40f3-8bb5-7fbf834d3034", "tag": "bb56c734-467a-4a0f-ac64-9ec157c05204"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:23.751182 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-3d62d4ee-78d3-473f-bbd1-50e7f00df7f0 req-97fc8b92-7fe3-47b3-a640-6a7dffd85de0 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:23.751631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-3d62d4ee-78d3-473f-bbd1-50e7f00df7f0 req-97fc8b92-7fe3-47b3-a640-6a7dffd85de0 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:23.766470 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-3d62d4ee-78d3-473f-bbd1-50e7f00df7f0 req-97fc8b92-7fe3-47b3-a640-6a7dffd85de0 service nova] Creating event network-changed:bb56c734-467a-4a0f-ac64-9ec157c05204 for instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 on hv-cinder-84330 May 25 17:14:23.771466 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-3d62d4ee-78d3-473f-bbd1-50e7f00df7f0 req-97fc8b92-7fe3-47b3-a640-6a7dffd85de0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032790 May 25 17:14:23.772069 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 325/679] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:24.434385 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-19927262-9403-4b46-8984-3c9a61f7c0b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:24.434961 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-19927262-9403-4b46-8984-3c9a61f7c0b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:24.435308 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3ca20221-5604-4cc6-8a4f-dd39c3a36197 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:24.436605 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3ca20221-5604-4cc6-8a4f-dd39c3a36197 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:24.442130 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-19927262-9403-4b46-8984-3c9a61f7c0b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:24.442661 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-19927262-9403-4b46-8984-3c9a61f7c0b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:24.443050 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ca20221-5604-4cc6-8a4f-dd39c3a36197 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:24.443566 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ca20221-5604-4cc6-8a4f-dd39c3a36197 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:24.443686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-19927262-9403-4b46-8984-3c9a61f7c0b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:24.444146 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-19927262-9403-4b46-8984-3c9a61f7c0b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:24.444589 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ca20221-5604-4cc6-8a4f-dd39c3a36197 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:24.445109 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3ca20221-5604-4cc6-8a4f-dd39c3a36197 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:24.468667 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-19927262-9403-4b46-8984-3c9a61f7c0b5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/ips" status: 200 len: 150 microversion: 2.1 time: 0.038842 May 25 17:14:24.469545 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 355/680] 10.222.0.31 () {58 vars in 1247 bytes} [Wed May 25 17:14:24 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:24.624378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3ca20221-5604-4cc6-8a4f-dd39c3a36197 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:24.632350 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3ca20221-5604-4cc6-8a4f-dd39c3a36197 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1364 microversion: 2.1 time: 0.202191 May 25 17:14:24.632965 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 326/681] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:24 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:25.649685 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e8dc3e72-7913-4dac-a140-f009c35b32c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:25.650297 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e8dc3e72-7913-4dac-a140-f009c35b32c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:25.656980 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8dc3e72-7913-4dac-a140-f009c35b32c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:25.657432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8dc3e72-7913-4dac-a140-f009c35b32c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:25.658453 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8dc3e72-7913-4dac-a140-f009c35b32c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:25.658938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8dc3e72-7913-4dac-a140-f009c35b32c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:25.794399 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e8dc3e72-7913-4dac-a140-f009c35b32c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:25.801828 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e8dc3e72-7913-4dac-a140-f009c35b32c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1364 microversion: 2.1 time: 0.156017 May 25 17:14:25.802551 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 356/682] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:25 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:25.822464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-063b4084-dc99-44d1-ba35-b2bdbcf140d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "951a3409-426c-4fa6-afb7-98b83834b804"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:25.823558 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-063b4084-dc99-44d1-ba35-b2bdbcf140d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:25.830135 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-063b4084-dc99-44d1-ba35-b2bdbcf140d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:25.830593 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-063b4084-dc99-44d1-ba35-b2bdbcf140d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:25.831408 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-063b4084-dc99-44d1-ba35-b2bdbcf140d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:25.831965 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-063b4084-dc99-44d1-ba35-b2bdbcf140d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:26.010195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d3d10dee-ed1f-4c0a-8878-811d058ce396 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:26.010699 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d3d10dee-ed1f-4c0a-8878-811d058ce396 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:26.017987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d3d10dee-ed1f-4c0a-8878-811d058ce396 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:26.018443 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d3d10dee-ed1f-4c0a-8878-811d058ce396 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:26.019252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d3d10dee-ed1f-4c0a-8878-811d058ce396 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:26.019699 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d3d10dee-ed1f-4c0a-8878-811d058ce396 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:26.047011 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d3d10dee-ed1f-4c0a-8878-811d058ce396 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:14:26.084618 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-063b4084-dc99-44d1-ba35-b2bdbcf140d1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266671 May 25 17:14:26.085643 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 327/683] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:14:25 2022] POST /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:14:26.139023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d3d10dee-ed1f-4c0a-8878-811d058ce396 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "DELETE /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 204 len: 0 microversion: 2.1 time: 0.131566 May 25 17:14:26.140780 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 357/684] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:14:26 2022] DELETE /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 17:14:26.151189 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-eb03bd7c-1523-44be-9a79-510046ae23c1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:26.153041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-eb03bd7c-1523-44be-9a79-510046ae23c1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:26.160005 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb03bd7c-1523-44be-9a79-510046ae23c1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:26.160610 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb03bd7c-1523-44be-9a79-510046ae23c1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:26.161536 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb03bd7c-1523-44be-9a79-510046ae23c1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:26.162039 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb03bd7c-1523-44be-9a79-510046ae23c1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:26.203328 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:26.226098 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=10 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:26.295778 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-eb03bd7c-1523-44be-9a79-510046ae23c1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:26.303302 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-eb03bd7c-1523-44be-9a79-510046ae23c1 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1507 microversion: 2.1 time: 0.157816 May 25 17:14:26.303907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 328/685] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:26 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:26.821949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-17e02370-0657-4250-b762-8dd82d532dda tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:26.822750 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-17e02370-0657-4250-b762-8dd82d532dda tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:26.824660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=6 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:26.830657 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17e02370-0657-4250-b762-8dd82d532dda tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:26.831113 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17e02370-0657-4250-b762-8dd82d532dda tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:26.831893 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17e02370-0657-4250-b762-8dd82d532dda tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:26.832335 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17e02370-0657-4250-b762-8dd82d532dda tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:26.977162 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-17e02370-0657-4250-b762-8dd82d532dda tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:26.985445 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-17e02370-0657-4250-b762-8dd82d532dda tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1364 microversion: 2.1 time: 0.168410 May 25 17:14:26.986004 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 358/686] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:26 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:27.322119 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-548ca195-9c00-49e3-b265-a4c545c50db6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:27.322735 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-548ca195-9c00-49e3-b265-a4c545c50db6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:27.329322 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-548ca195-9c00-49e3-b265-a4c545c50db6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:27.329805 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-548ca195-9c00-49e3-b265-a4c545c50db6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:27.330591 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-548ca195-9c00-49e3-b265-a4c545c50db6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:27.331033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-548ca195-9c00-49e3-b265-a4c545c50db6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:27.468464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-548ca195-9c00-49e3-b265-a4c545c50db6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:27.472404 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:27.478282 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-548ca195-9c00-49e3-b265-a4c545c50db6 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1507 microversion: 2.1 time: 0.160287 May 25 17:14:27.478640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 329/687] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:27 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:28.003932 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f84f0a29-0943-40d6-86d5-e0d544e0b14d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:28.004475 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f84f0a29-0943-40d6-86d5-e0d544e0b14d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:28.011153 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f84f0a29-0943-40d6-86d5-e0d544e0b14d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:28.011671 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f84f0a29-0943-40d6-86d5-e0d544e0b14d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:28.012589 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f84f0a29-0943-40d6-86d5-e0d544e0b14d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:28.013090 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f84f0a29-0943-40d6-86d5-e0d544e0b14d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:28.139468 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f84f0a29-0943-40d6-86d5-e0d544e0b14d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:28.146866 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f84f0a29-0943-40d6-86d5-e0d544e0b14d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1364 microversion: 2.1 time: 0.147055 May 25 17:14:28.147423 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 359/688] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:27 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:28.606988 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cc65d37d-50c0-4fa7-91e1-241a44fde54d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:28.607594 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cc65d37d-50c0-4fa7-91e1-241a44fde54d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:28.613757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cc65d37d-50c0-4fa7-91e1-241a44fde54d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:28.614152 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cc65d37d-50c0-4fa7-91e1-241a44fde54d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:28.614902 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cc65d37d-50c0-4fa7-91e1-241a44fde54d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:28.615334 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cc65d37d-50c0-4fa7-91e1-241a44fde54d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:28.812652 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-d8be02ce-bfb4-4dc2-a96f-72c3bdb11435 req-c6fc18a3-f9ca-4fb1-97f0-d016bddca336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3259a826-9d68-40f3-8bb5-7fbf834d3034", "name": "network-vif-plugged", "status": "completed", "tag": "bb56c734-467a-4a0f-ac64-9ec157c05204"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:28.828394 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-d8be02ce-bfb4-4dc2-a96f-72c3bdb11435 req-c6fc18a3-f9ca-4fb1-97f0-d016bddca336 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:28.828928 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-d8be02ce-bfb4-4dc2-a96f-72c3bdb11435 req-c6fc18a3-f9ca-4fb1-97f0-d016bddca336 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:28.842726 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-d8be02ce-bfb4-4dc2-a96f-72c3bdb11435 req-c6fc18a3-f9ca-4fb1-97f0-d016bddca336 service nova] Creating event network-vif-plugged:bb56c734-467a-4a0f-ac64-9ec157c05204 for instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 on hv-cinder-84330 May 25 17:14:28.846435 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-d8be02ce-bfb4-4dc2-a96f-72c3bdb11435 req-c6fc18a3-f9ca-4fb1-97f0-d016bddca336 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042758 May 25 17:14:28.847620 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 360/689] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:14:29.027857 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cc65d37d-50c0-4fa7-91e1-241a44fde54d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:29.035680 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cc65d37d-50c0-4fa7-91e1-241a44fde54d tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1507 microversion: 2.1 time: 0.544748 May 25 17:14:29.046543 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 330/690] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:28 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1507 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:29.164186 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ebb3cac3-088f-479a-a565-cb1f7e459b1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:29.166109 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ebb3cac3-088f-479a-a565-cb1f7e459b1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:29.173770 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ebb3cac3-088f-479a-a565-cb1f7e459b1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:29.174224 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ebb3cac3-088f-479a-a565-cb1f7e459b1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:29.174992 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ebb3cac3-088f-479a-a565-cb1f7e459b1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:29.175463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ebb3cac3-088f-479a-a565-cb1f7e459b1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:29.328476 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ebb3cac3-088f-479a-a565-cb1f7e459b1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:29.334153 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-bf5c1ade-130c-47f7-bddd-32318bfa6e06 req-4bf5dbdb-12f9-4904-acc7-bdc6263755cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255e860e-8389-4f93-b7d0-2d80d7b7ad7d", "name": "network-vif-deleted", "tag": "4708bad2-cbd1-44cd-9155-df4a2de8c416"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:29.343146 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ebb3cac3-088f-479a-a565-cb1f7e459b1c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1364 microversion: 2.1 time: 0.182247 May 25 17:14:29.344384 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-bf5c1ade-130c-47f7-bddd-32318bfa6e06 req-4bf5dbdb-12f9-4904-acc7-bdc6263755cd service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:29.345635 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 361/691] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:29 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:29.353857 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-bf5c1ade-130c-47f7-bddd-32318bfa6e06 req-4bf5dbdb-12f9-4904-acc7-bdc6263755cd service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:29.365582 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-bf5c1ade-130c-47f7-bddd-32318bfa6e06 req-4bf5dbdb-12f9-4904-acc7-bdc6263755cd service nova] Creating event network-vif-deleted:4708bad2-cbd1-44cd-9155-df4a2de8c416 for instance 255e860e-8389-4f93-b7d0-2d80d7b7ad7d on hv-cinder-84330 May 25 17:14:29.371465 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-bf5c1ade-130c-47f7-bddd-32318bfa6e06 req-4bf5dbdb-12f9-4904-acc7-bdc6263755cd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041603 May 25 17:14:29.372053 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 331/692] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:14:30.053890 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:30.054435 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:30.061123 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:30.061828 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:30.062581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:30.063014 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:30.092906 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:30.093349 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:30.093789 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lazy-loading 'fault' on Instance uuid 255e860e-8389-4f93-b7d0-2d80d7b7ad7d {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:14:30.134143 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:30.141585 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-60a6e6b7-65a0-4c97-a34f-fa4badf4850c tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 200 len: 1311 microversion: 2.1 time: 0.091625 May 25 17:14:30.142146 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 362/693] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:30 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:30.362958 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-53a90e3f-b177-4618-9b58-2904bf4b09ad tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:30.363333 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-53a90e3f-b177-4618-9b58-2904bf4b09ad tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:30.371004 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53a90e3f-b177-4618-9b58-2904bf4b09ad tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:30.371465 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53a90e3f-b177-4618-9b58-2904bf4b09ad tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:30.372242 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53a90e3f-b177-4618-9b58-2904bf4b09ad tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:30.372732 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53a90e3f-b177-4618-9b58-2904bf4b09ad tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:30.515529 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-53a90e3f-b177-4618-9b58-2904bf4b09ad tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:30.522944 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-53a90e3f-b177-4618-9b58-2904bf4b09ad tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1364 microversion: 2.1 time: 0.164813 May 25 17:14:30.523504 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 332/694] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:30 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:31.158789 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a37ffbb1-dc8a-49b9-8cc1-7bb8538b67bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:31.159418 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a37ffbb1-dc8a-49b9-8cc1-7bb8538b67bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 255e860e-8389-4f93-b7d0-2d80d7b7ad7d] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:31.166488 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a37ffbb1-dc8a-49b9-8cc1-7bb8538b67bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:31.166937 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a37ffbb1-dc8a-49b9-8cc1-7bb8538b67bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:31.167697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a37ffbb1-dc8a-49b9-8cc1-7bb8538b67bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:31.168136 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a37ffbb1-dc8a-49b9-8cc1-7bb8538b67bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:31.181397 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-a37ffbb1-dc8a-49b9-8cc1-7bb8538b67bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] HTTP exception thrown: Instance 255e860e-8389-4f93-b7d0-2d80d7b7ad7d could not be found. May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a37ffbb1-dc8a-49b9-8cc1-7bb8538b67bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Request method failure captured: May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d HTTP/1.1 May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLGYNd6G28K1F5Vwuevv8bNAGGyG1KQn063AvRNDkhQrhv_VbNEELILAkCaqLFEwEvi0Dvqfjkudz0zR6iHLoRxopgyicuFaijxVda3PK2EFG_6MHUTTsVLuxNFtbXb3F8H7RaOoUvDqTOonq2st05ntld3RmPG6CBG3ac_shdb1ug May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 8c297ec7b46943f594b67c95479f1f7c May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:14:31.183035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/8c297ec7b46943f594b67c95479f1f7c"}]}] May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 8c297ec7b46943f594b67c95479f1f7c May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-ServerRescueNegativeTestJSON-122117092-project May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3f51c03f7fe54451b49ddb32fc337b98 May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-122117092-project May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 255e860e-8389-4f93-b7d0-2d80d7b7ad7d could not be found. May 25 17:14:31.184527 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '255e860e-8389-4f93-b7d0-2d80d7b7ad7d'} May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 255e860e-8389-4f93-b7d0-2d80d7b7ad7d could not be found. May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:14:31.185489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 255e860e-8389-4f93-b7d0-2d80d7b7ad7d could not be found. May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 255e860e-8389-4f93-b7d0-2d80d7b7ad7d could not be found. May 25 17:14:31.187236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:31.188695 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a37ffbb1-dc8a-49b9-8cc1-7bb8538b67bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Returning 404 to user: Instance 255e860e-8389-4f93-b7d0-2d80d7b7ad7d could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:14:31.188695 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a37ffbb1-dc8a-49b9-8cc1-7bb8538b67bb tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d" status: 404 len: 111 microversion: 2.1 time: 0.029515 May 25 17:14:31.188695 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 363/695] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:31 2022] GET /compute/v2.1/servers/255e860e-8389-4f93-b7d0-2d80d7b7ad7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:14:31.193023 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d5b4f807-741d-4dcb-bb87-cdb9af031dee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:31.193523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d5b4f807-741d-4dcb-bb87-cdb9af031dee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:31.200272 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5b4f807-741d-4dcb-bb87-cdb9af031dee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:31.200744 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5b4f807-741d-4dcb-bb87-cdb9af031dee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:31.201507 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5b4f807-741d-4dcb-bb87-cdb9af031dee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:31.201940 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5b4f807-741d-4dcb-bb87-cdb9af031dee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:31.227259 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d5b4f807-741d-4dcb-bb87-cdb9af031dee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:14:31.300331 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d5b4f807-741d-4dcb-bb87-cdb9af031dee tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 204 len: 0 microversion: 2.1 time: 0.110797 May 25 17:14:31.300956 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 333/696] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:14:31 2022] DELETE /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:14:31.309531 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-cf3c0eba-8f29-4dd2-abc9-2b37e5dd315e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:31.310158 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-cf3c0eba-8f29-4dd2-abc9-2b37e5dd315e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:31.316570 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cf3c0eba-8f29-4dd2-abc9-2b37e5dd315e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:31.317054 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cf3c0eba-8f29-4dd2-abc9-2b37e5dd315e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:31.317819 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cf3c0eba-8f29-4dd2-abc9-2b37e5dd315e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:31.318262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cf3c0eba-8f29-4dd2-abc9-2b37e5dd315e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:31.451051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-cf3c0eba-8f29-4dd2-abc9-2b37e5dd315e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:31.458704 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-cf3c0eba-8f29-4dd2-abc9-2b37e5dd315e tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.153715 May 25 17:14:31.459255 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 364/697] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:31 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:31.541584 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-dcffcb43-48de-4428-8220-8dba0425ff7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:31.542290 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-dcffcb43-48de-4428-8220-8dba0425ff7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:31.548893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dcffcb43-48de-4428-8220-8dba0425ff7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:31.549349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dcffcb43-48de-4428-8220-8dba0425ff7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:31.550131 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dcffcb43-48de-4428-8220-8dba0425ff7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:31.550568 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dcffcb43-48de-4428-8220-8dba0425ff7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:31.681865 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-dcffcb43-48de-4428-8220-8dba0425ff7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:31.689676 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-dcffcb43-48de-4428-8220-8dba0425ff7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1548 microversion: 2.1 time: 0.153283 May 25 17:14:31.690237 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 334/698] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:31 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:31.707041 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a22f9658-d088-4eb0-a3e9-b73d85977be6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:31.707529 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a22f9658-d088-4eb0-a3e9-b73d85977be6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:31.713516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a22f9658-d088-4eb0-a3e9-b73d85977be6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:31.713959 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a22f9658-d088-4eb0-a3e9-b73d85977be6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:31.714705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a22f9658-d088-4eb0-a3e9-b73d85977be6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:31.715141 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a22f9658-d088-4eb0-a3e9-b73d85977be6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:31.794222 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a22f9658-d088-4eb0-a3e9-b73d85977be6 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090957 May 25 17:14:31.794843 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 365/699] 10.222.0.31 () {58 vars in 1274 bytes} [Wed May 25 17:14:31 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:32.478009 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-32998f7e-393a-4c52-8e7e-6812411be945 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:32.478700 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-32998f7e-393a-4c52-8e7e-6812411be945 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:32.484903 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-32998f7e-393a-4c52-8e7e-6812411be945 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:32.485358 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-32998f7e-393a-4c52-8e7e-6812411be945 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:32.486140 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-32998f7e-393a-4c52-8e7e-6812411be945 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:32.486579 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-32998f7e-393a-4c52-8e7e-6812411be945 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:32.633632 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-32998f7e-393a-4c52-8e7e-6812411be945 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:32.641427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-32998f7e-393a-4c52-8e7e-6812411be945 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.168010 May 25 17:14:32.642012 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 335/700] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:32 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:32.880879 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1343979202", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-500528931", "security_groups": [{"name": "tempest-secgroup-smoke-215202645"}], "block_device_mapping_v2": [{"uuid": "9e4c7db4-ac13-40e4-a58c-02baca75239c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f83d3faf-d265-477f-8499-04e56bb140df"}]}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:33.007035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-64760d29-07fe-4979-b212-c55789e82221 req-28dce648-ad25-41ee-a50e-8339ca18d25b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3259a826-9d68-40f3-8bb5-7fbf834d3034", "tag": "bb56c734-467a-4a0f-ac64-9ec157c05204"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:33.016021 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-64760d29-07fe-4979-b212-c55789e82221 req-28dce648-ad25-41ee-a50e-8339ca18d25b service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:33.016876 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-64760d29-07fe-4979-b212-c55789e82221 req-28dce648-ad25-41ee-a50e-8339ca18d25b service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:33.022687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.network.neutron [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] validate_networks() for [('f83d3faf-d265-477f-8499-04e56bb140df', None, None, None, None, None)] {{(pid=117695) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:14:33.033056 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-64760d29-07fe-4979-b212-c55789e82221 req-28dce648-ad25-41ee-a50e-8339ca18d25b service nova] Creating event network-changed:bb56c734-467a-4a0f-ac64-9ec157c05204 for instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 on hv-cinder-84330 May 25 17:14:33.037961 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-64760d29-07fe-4979-b212-c55789e82221 req-28dce648-ad25-41ee-a50e-8339ca18d25b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034551 May 25 17:14:33.038815 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 336/701] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:14:33.463662 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Flavor limits 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:14:33.464087 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Image limits 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:14:33.464562 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Flavor pref 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:14:33.465009 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Image pref 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:14:33.465453 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:14:33.474400 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:33.474886 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:33.475687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:33.476126 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:33.494464 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Getting quotas for project df9bc8d103cf40e1b8d984f1947e7c5d. Resources: {'ram', 'instances', 'cores'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:14:33.496739 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:33.499105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Getting quotas for user 47642301725e4023aba48b2a3a64d5b9 and project df9bc8d103cf40e1b8d984f1947e7c5d. Resources: {'ram', 'instances', 'cores'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:14:33.564243 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Going to run 1 instances... {{(pid=117695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:14:33.566871 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e4c7db4-ac13-40e4-a58c-02baca75239c',volume_size=None,volume_type=None)] {{(pid=117695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:14:33.665605 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c46139c3-8491-4b57-8b2a-3e12b6171434 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:33.667159 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c46139c3-8491-4b57-8b2a-3e12b6171434 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:33.689212 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c46139c3-8491-4b57-8b2a-3e12b6171434 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:33.689908 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c46139c3-8491-4b57-8b2a-3e12b6171434 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:33.691068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c46139c3-8491-4b57-8b2a-3e12b6171434 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:33.691774 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c46139c3-8491-4b57-8b2a-3e12b6171434 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:33.734135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ad1c813a-0f15-47f7-a894-7d374d9c0347 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.857507 May 25 17:14:33.740183 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 366/702] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:14:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:14:33.756896 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-80775162-3534-46eb-9bde-976afc1d5d9b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:33.756896 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-80775162-3534-46eb-9bde-976afc1d5d9b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:33.826042 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-80775162-3534-46eb-9bde-976afc1d5d9b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:33.832865 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-80775162-3534-46eb-9bde-976afc1d5d9b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1094 microversion: 2.1 time: 0.080675 May 25 17:14:33.833450 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 367/703] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:33 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:33.874630 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c46139c3-8491-4b57-8b2a-3e12b6171434 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:33.884376 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c46139c3-8491-4b57-8b2a-3e12b6171434 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.226978 May 25 17:14:33.885374 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 337/704] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:33 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:34.851843 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ab08a0d6-b663-4f2f-992f-02d1f97bb590 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:34.852531 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ab08a0d6-b663-4f2f-992f-02d1f97bb590 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:34.859916 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ab08a0d6-b663-4f2f-992f-02d1f97bb590 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:34.860375 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ab08a0d6-b663-4f2f-992f-02d1f97bb590 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:34.861181 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ab08a0d6-b663-4f2f-992f-02d1f97bb590 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:34.861632 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ab08a0d6-b663-4f2f-992f-02d1f97bb590 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:34.902885 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-99d6fc84-30bf-4db8-aae7-ad651fe8b915 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:34.903805 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-99d6fc84-30bf-4db8-aae7-ad651fe8b915 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:34.911202 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-99d6fc84-30bf-4db8-aae7-ad651fe8b915 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:34.911659 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-99d6fc84-30bf-4db8-aae7-ad651fe8b915 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:34.912439 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-99d6fc84-30bf-4db8-aae7-ad651fe8b915 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:34.912920 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-99d6fc84-30bf-4db8-aae7-ad651fe8b915 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:34.922872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ab08a0d6-b663-4f2f-992f-02d1f97bb590 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:34.930460 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ab08a0d6-b663-4f2f-992f-02d1f97bb590 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1136 microversion: 2.1 time: 0.082897 May 25 17:14:34.930952 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 368/705] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:34 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:35.158624 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-99d6fc84-30bf-4db8-aae7-ad651fe8b915 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:35.166528 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-99d6fc84-30bf-4db8-aae7-ad651fe8b915 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1522 microversion: 2.1 time: 0.268969 May 25 17:14:35.166784 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 338/706] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:34 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:35.953748 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d7b9e526-821a-4ccb-893b-ec32cb57c242 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:35.954362 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d7b9e526-821a-4ccb-893b-ec32cb57c242 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:35.956830 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6c179eb3-a3b2-47e1-8ab7-8410c831557f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "951a3409-426c-4fa6-afb7-98b83834b804"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:35.958374 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6c179eb3-a3b2-47e1-8ab7-8410c831557f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:35.973039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d7b9e526-821a-4ccb-893b-ec32cb57c242 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:35.973670 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d7b9e526-821a-4ccb-893b-ec32cb57c242 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:35.974811 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d7b9e526-821a-4ccb-893b-ec32cb57c242 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:35.975554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d7b9e526-821a-4ccb-893b-ec32cb57c242 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:35.976428 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c179eb3-a3b2-47e1-8ab7-8410c831557f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:35.977598 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c179eb3-a3b2-47e1-8ab7-8410c831557f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:35.978423 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c179eb3-a3b2-47e1-8ab7-8410c831557f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:35.979869 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c179eb3-a3b2-47e1-8ab7-8410c831557f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:36.081059 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d7b9e526-821a-4ccb-893b-ec32cb57c242 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:36.093335 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d7b9e526-821a-4ccb-893b-ec32cb57c242 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1210 microversion: 2.1 time: 0.143269 May 25 17:14:36.093836 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-6c179eb3-a3b2-47e1-8ab7-8410c831557f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Invalid volume: volume 951a3409-426c-4fa6-afb7-98b83834b804 is already attached to instances: d856fd3d-ee9c-45ec-b4a1-46789378a5ef May 25 17:14:36.094240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 369/707] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:35 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1210 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6c179eb3-a3b2-47e1-8ab7-8410c831557f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: POST /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments HTTP/1.1 May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 74 May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:14:36.096455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {"volumeAttachment": {"volumeId": "951a3409-426c-4fa6-afb7-98b83834b804"}} May 25 17:14:36.098033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Invalid volume: volume 951a3409-426c-4fa6-afb7-98b83834b804 is already attached to instances: d856fd3d-ee9c-45ec-b4a1-46789378a5ef May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'server_id': 'd856fd3d-ee9c-45ec-b4a1-46789378a5ef', 'body': {'volumeAttachment': {'volumeId': '951a3409-426c-4fa6-afb7-98b83834b804'}}} May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 951a3409-426c-4fa6-afb7-98b83834b804 is already attached to instances: d856fd3d-ee9c-45ec-b4a1-46789378a5ef May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:36.098891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 951a3409-426c-4fa6-afb7-98b83834b804 is already attached to instances: d856fd3d-ee9c-45ec-b4a1-46789378a5ef May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:36.100251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:36.101796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:36.101796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:14:36.101796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:14:36.101796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 951a3409-426c-4fa6-afb7-98b83834b804 is already attached to instances: d856fd3d-ee9c-45ec-b4a1-46789378a5ef May 25 17:14:36.101796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:36.101796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6c179eb3-a3b2-47e1-8ab7-8410c831557f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 400 to user: Invalid volume: volume 951a3409-426c-4fa6-afb7-98b83834b804 is already attached to instances: d856fd3d-ee9c-45ec-b4a1-46789378a5ef {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:14:36.101796 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6c179eb3-a3b2-47e1-8ab7-8410c831557f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147422 May 25 17:14:36.104877 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 339/708] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:14:35 2022] POST /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 25 17:14:36.167579 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5fb961f4-9a1c-4608-9c7d-47512e40ff0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:36.168084 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5fb961f4-9a1c-4608-9c7d-47512e40ff0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:36.175279 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5fb961f4-9a1c-4608-9c7d-47512e40ff0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:36.175725 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5fb961f4-9a1c-4608-9c7d-47512e40ff0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:36.176512 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5fb961f4-9a1c-4608-9c7d-47512e40ff0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:36.177158 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5fb961f4-9a1c-4608-9c7d-47512e40ff0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:36.183486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-83b5b858-bbc2-4050-9552-a50ac5e63417 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:36.184267 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-83b5b858-bbc2-4050-9552-a50ac5e63417 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:36.186910 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:36.202359 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83b5b858-bbc2-4050-9552-a50ac5e63417 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:36.205297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83b5b858-bbc2-4050-9552-a50ac5e63417 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:36.208654 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83b5b858-bbc2-4050-9552-a50ac5e63417 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:36.209573 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-83b5b858-bbc2-4050-9552-a50ac5e63417 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:36.291515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-5fb961f4-9a1c-4608-9c7d-47512e40ff0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lazy-loading 'services' on Instance uuid d856fd3d-ee9c-45ec-b4a1-46789378a5ef {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:14:36.418044 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5fb961f4-9a1c-4608-9c7d-47512e40ff0e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments/951a3409-426c-4fa6-afb7-98b83834b804" status: 202 len: 0 microversion: 2.1 time: 0.255211 May 25 17:14:36.419853 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 370/709] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:14:36 2022] DELETE /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments/951a3409-426c-4fa6-afb7-98b83834b804 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:14:36.448319 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b26523cf-8c0e-49e5-886e-8e14a7d4d7d0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:36.450259 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b26523cf-8c0e-49e5-886e-8e14a7d4d7d0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:36.459440 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-83b5b858-bbc2-4050-9552-a50ac5e63417 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c03f7fe54451b49ddb32fc337b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c297ec7b46943f594b67c95479f1f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:36.465967 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b26523cf-8c0e-49e5-886e-8e14a7d4d7d0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:36.466818 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b26523cf-8c0e-49e5-886e-8e14a7d4d7d0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:36.468443 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b26523cf-8c0e-49e5-886e-8e14a7d4d7d0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:36.470419 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b26523cf-8c0e-49e5-886e-8e14a7d4d7d0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:36.481508 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-83b5b858-bbc2-4050-9552-a50ac5e63417 tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 200 len: 1480 microversion: 2.1 time: 0.302489 May 25 17:14:36.482457 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 340/710] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:36 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 1480 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:36.546392 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:36.553588 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b26523cf-8c0e-49e5-886e-8e14a7d4d7d0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128875 May 25 17:14:36.554851 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 371/711] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:14:36 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:36.634431 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-de8e22bb-2a48-4e98-85db-11164b8fc009 req-ba20b9b4-9219-4e69-864d-11c0a31793c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f434295-7a0d-4d51-8f4e-6698b399b20a", "name": "network-vif-deleted", "tag": "3c00686d-3bd0-4e09-a004-2c18e278c159"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:36.646058 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-de8e22bb-2a48-4e98-85db-11164b8fc009 req-ba20b9b4-9219-4e69-864d-11c0a31793c8 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:36.646937 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-de8e22bb-2a48-4e98-85db-11164b8fc009 req-ba20b9b4-9219-4e69-864d-11c0a31793c8 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:36.660990 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-de8e22bb-2a48-4e98-85db-11164b8fc009 req-ba20b9b4-9219-4e69-864d-11c0a31793c8 service nova] Creating event network-vif-deleted:3c00686d-3bd0-4e09-a004-2c18e278c159 for instance 8f434295-7a0d-4d51-8f4e-6698b399b20a on hv-cinder-84330 May 25 17:14:36.667189 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-de8e22bb-2a48-4e98-85db-11164b8fc009 req-ba20b9b4-9219-4e69-864d-11c0a31793c8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175867 May 25 17:14:36.668072 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 341/712] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:37.110817 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-268fa583-2b61-4441-8445-ab32300c3389 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:37.111535 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-268fa583-2b61-4441-8445-ab32300c3389 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:37.119020 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-268fa583-2b61-4441-8445-ab32300c3389 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:37.119721 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-268fa583-2b61-4441-8445-ab32300c3389 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:37.120573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-268fa583-2b61-4441-8445-ab32300c3389 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:37.121105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-268fa583-2b61-4441-8445-ab32300c3389 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:37.341830 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-268fa583-2b61-4441-8445-ab32300c3389 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:37.349737 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-268fa583-2b61-4441-8445-ab32300c3389 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.242735 May 25 17:14:37.356875 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 372/713] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:37 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:37.500356 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-893d978a-14e5-4ece-a9e8-86fc2751038f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:37.505490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-893d978a-14e5-4ece-a9e8-86fc2751038f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] [instance: 8f434295-7a0d-4d51-8f4e-6698b399b20a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:37.521891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-893d978a-14e5-4ece-a9e8-86fc2751038f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:37.522269 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-893d978a-14e5-4ece-a9e8-86fc2751038f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:37.523072 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-893d978a-14e5-4ece-a9e8-86fc2751038f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:37.524251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-893d978a-14e5-4ece-a9e8-86fc2751038f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:37.539172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-893d978a-14e5-4ece-a9e8-86fc2751038f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] HTTP exception thrown: Instance 8f434295-7a0d-4d51-8f4e-6698b399b20a could not be found. May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-893d978a-14e5-4ece-a9e8-86fc2751038f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Request method failure captured: May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a HTTP/1.1 May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLGYNd6G28K1F5Vwuevv8bNAGGyG1KQn063AvRNDkhQrhv_VbNEELILAkCaqLFEwEvi0Dvqfjkudz0zR6iHLoRxopgyicuFaijxVda3PK2EFG_6MHUTTsVLuxNFtbXb3F8H7RaOoUvDqTOonq2st05ntld3RmPG6CBG3ac_shdb1ug May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 8c297ec7b46943f594b67c95479f1f7c May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:14:37.540948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/8c297ec7b46943f594b67c95479f1f7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/8c297ec7b46943f594b67c95479f1f7c"}]}] May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 8c297ec7b46943f594b67c95479f1f7c May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-122117092 May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-ServerRescueNegativeTestJSON-122117092-project May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 3f51c03f7fe54451b49ddb32fc337b98 May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-122117092-project May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 8f434295-7a0d-4d51-8f4e-6698b399b20a could not be found. May 25 17:14:37.542438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '8f434295-7a0d-4d51-8f4e-6698b399b20a'} May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f434295-7a0d-4d51-8f4e-6698b399b20a could not be found. May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:14:37.543260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f434295-7a0d-4d51-8f4e-6698b399b20a could not be found. May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f434295-7a0d-4d51-8f4e-6698b399b20a could not be found. May 25 17:14:37.544717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:14:37.546570 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-893d978a-14e5-4ece-a9e8-86fc2751038f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] Returning 404 to user: Instance 8f434295-7a0d-4d51-8f4e-6698b399b20a could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:14:37.547563 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-893d978a-14e5-4ece-a9e8-86fc2751038f tempest-ServerRescueNegativeTestJSON-122117092 tempest-ServerRescueNegativeTestJSON-122117092-project] 10.222.0.31 "GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a" status: 404 len: 111 microversion: 2.1 time: 0.052601 May 25 17:14:37.548277 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 342/714] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:37 2022] GET /compute/v2.1/servers/8f434295-7a0d-4d51-8f4e-6698b399b20a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:14:37.569692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-fcef35fd-d7e4-49f8-bb58-2f1b1f0a4e80 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:37.572211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-fcef35fd-d7e4-49f8-bb58-2f1b1f0a4e80 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:37.579942 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fcef35fd-d7e4-49f8-bb58-2f1b1f0a4e80 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:37.580405 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fcef35fd-d7e4-49f8-bb58-2f1b1f0a4e80 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:37.581206 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fcef35fd-d7e4-49f8-bb58-2f1b1f0a4e80 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:37.581653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-fcef35fd-d7e4-49f8-bb58-2f1b1f0a4e80 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:37.621100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-fcef35fd-d7e4-49f8-bb58-2f1b1f0a4e80 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057223 May 25 17:14:37.629715 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 373/715] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:14:37 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:37.794206 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-9f01e01f-ef4b-4bd6-bfbd-cfdaf5b4c854 req-91050b26-4e23-478c-b1dc-6c7c85d91ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48a0fde-a6e2-447e-b977-2a8d2ecca65f", "tag": "e4baaf10-25ec-45f6-8706-8a010940d744"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:37.811763 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-9f01e01f-ef4b-4bd6-bfbd-cfdaf5b4c854 req-91050b26-4e23-478c-b1dc-6c7c85d91ed2 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:37.812478 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-9f01e01f-ef4b-4bd6-bfbd-cfdaf5b4c854 req-91050b26-4e23-478c-b1dc-6c7c85d91ed2 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:37.828779 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-9f01e01f-ef4b-4bd6-bfbd-cfdaf5b4c854 req-91050b26-4e23-478c-b1dc-6c7c85d91ed2 service nova] Creating event network-changed:e4baaf10-25ec-45f6-8706-8a010940d744 for instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f on hv-cinder-84330 May 25 17:14:37.834331 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-9f01e01f-ef4b-4bd6-bfbd-cfdaf5b4c854 req-91050b26-4e23-478c-b1dc-6c7c85d91ed2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044955 May 25 17:14:37.836087 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 343/716] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:38.367439 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0d7b6c3a-da25-4774-b2ff-c1936f1f5306 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:38.368098 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0d7b6c3a-da25-4774-b2ff-c1936f1f5306 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:38.374222 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0d7b6c3a-da25-4774-b2ff-c1936f1f5306 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:38.374665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0d7b6c3a-da25-4774-b2ff-c1936f1f5306 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:38.375415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0d7b6c3a-da25-4774-b2ff-c1936f1f5306 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:38.375846 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0d7b6c3a-da25-4774-b2ff-c1936f1f5306 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:38.634695 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d5037861-11f0-4ae9-8685-3cbf54e88049 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:38.635639 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d5037861-11f0-4ae9-8685-3cbf54e88049 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:38.641982 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5037861-11f0-4ae9-8685-3cbf54e88049 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:38.642426 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5037861-11f0-4ae9-8685-3cbf54e88049 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:38.643215 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5037861-11f0-4ae9-8685-3cbf54e88049 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:38.643644 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5037861-11f0-4ae9-8685-3cbf54e88049 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:38.676142 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d5037861-11f0-4ae9-8685-3cbf54e88049 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046671 May 25 17:14:38.681946 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 344/717] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:14:38 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 17:14:38.746584 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a8b495fe-0bdf-4071-a513-93ac9eaa8180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:38.747080 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a8b495fe-0bdf-4071-a513-93ac9eaa8180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:38.753091 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a8b495fe-0bdf-4071-a513-93ac9eaa8180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:38.753546 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a8b495fe-0bdf-4071-a513-93ac9eaa8180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:38.754311 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a8b495fe-0bdf-4071-a513-93ac9eaa8180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:38.754747 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a8b495fe-0bdf-4071-a513-93ac9eaa8180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:38.781958 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a8b495fe-0bdf-4071-a513-93ac9eaa8180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:14:38.861010 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a8b495fe-0bdf-4071-a513-93ac9eaa8180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 204 len: 0 microversion: 2.1 time: 0.118432 May 25 17:14:38.862007 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 345/718] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:14:38 2022] DELETE /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 17:14:38.871994 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-00bc4e2d-40d6-4010-a821-f9a22cbb85a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:38.872859 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-00bc4e2d-40d6-4010-a821-f9a22cbb85a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:38.879735 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-00bc4e2d-40d6-4010-a821-f9a22cbb85a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:38.880199 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-00bc4e2d-40d6-4010-a821-f9a22cbb85a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:38.881015 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-00bc4e2d-40d6-4010-a821-f9a22cbb85a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:38.881449 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-00bc4e2d-40d6-4010-a821-f9a22cbb85a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:38.901338 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:38.930561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0d7b6c3a-da25-4774-b2ff-c1936f1f5306 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:38.938415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0d7b6c3a-da25-4774-b2ff-c1936f1f5306 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.574847 May 25 17:14:38.938984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 374/719] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:38 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:39.023067 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-00bc4e2d-40d6-4010-a821-f9a22cbb85a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:39.031518 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-00bc4e2d-40d6-4010-a821-f9a22cbb85a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1682 microversion: 2.1 time: 0.165088 May 25 17:14:39.032099 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 346/720] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:38 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:39.373061 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-68765d1e-1bc2-41ed-a419-f1338d255770 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:39.373638 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-68765d1e-1bc2-41ed-a419-f1338d255770 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:39.380210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-68765d1e-1bc2-41ed-a419-f1338d255770 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:39.380833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-68765d1e-1bc2-41ed-a419-f1338d255770 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:39.381727 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-68765d1e-1bc2-41ed-a419-f1338d255770 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:39.382262 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-68765d1e-1bc2-41ed-a419-f1338d255770 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:39.409121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-68765d1e-1bc2-41ed-a419-f1338d255770 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/ips" status: 200 len: 153 microversion: 2.20 time: 0.150709 May 25 17:14:39.409848 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 375/721] 10.222.0.31 () {60 vars in 1288 bytes} [Wed May 25 17:14:39 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/ips => generated 153 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 17:14:39.957348 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fb6977da-9c5c-4b5d-a53b-89c5974b0de7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:39.957963 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fb6977da-9c5c-4b5d-a53b-89c5974b0de7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:39.966239 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb6977da-9c5c-4b5d-a53b-89c5974b0de7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:39.966698 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb6977da-9c5c-4b5d-a53b-89c5974b0de7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:39.967540 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb6977da-9c5c-4b5d-a53b-89c5974b0de7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:39.968037 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb6977da-9c5c-4b5d-a53b-89c5974b0de7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:40.054287 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-93d15123-ea07-45b7-b163-947bb7689a79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:40.055441 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-93d15123-ea07-45b7-b163-947bb7689a79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:40.081995 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-93d15123-ea07-45b7-b163-947bb7689a79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:40.082795 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-93d15123-ea07-45b7-b163-947bb7689a79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:40.084097 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-93d15123-ea07-45b7-b163-947bb7689a79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:40.084946 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-93d15123-ea07-45b7-b163-947bb7689a79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:40.181680 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fb6977da-9c5c-4b5d-a53b-89c5974b0de7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:40.192054 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fb6977da-9c5c-4b5d-a53b-89c5974b0de7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.238837 May 25 17:14:40.192929 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 347/722] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:39 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:40.355680 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-93d15123-ea07-45b7-b163-947bb7689a79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:40.369116 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-93d15123-ea07-45b7-b163-947bb7689a79 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1682 microversion: 2.1 time: 0.323465 May 25 17:14:40.369868 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 376/723] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:40 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1682 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:41.214351 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-157c0132-0e2e-40b0-83d4-ad40b0d0f156 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:41.215602 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-157c0132-0e2e-40b0-83d4-ad40b0d0f156 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:41.223026 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-157c0132-0e2e-40b0-83d4-ad40b0d0f156 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:41.223578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-157c0132-0e2e-40b0-83d4-ad40b0d0f156 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:41.224452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-157c0132-0e2e-40b0-83d4-ad40b0d0f156 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:41.225029 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-157c0132-0e2e-40b0-83d4-ad40b0d0f156 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:41.271810 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-82f8bfdd-59a2-4354-b986-f44eafae5c27 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:41.272492 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-82f8bfdd-59a2-4354-b986-f44eafae5c27 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:41.294784 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-82f8bfdd-59a2-4354-b986-f44eafae5c27 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:41.295369 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-82f8bfdd-59a2-4354-b986-f44eafae5c27 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:41.296383 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-82f8bfdd-59a2-4354-b986-f44eafae5c27 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:41.300815 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-82f8bfdd-59a2-4354-b986-f44eafae5c27 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:41.344580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-82f8bfdd-59a2-4354-b986-f44eafae5c27 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lazy-loading 'flavor' on Instance uuid 64a32d7a-f536-4bc3-8048-cfcb457b2881 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:14:41.652894 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-82f8bfdd-59a2-4354-b986-f44eafae5c27 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "POST /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/action" status: 202 len: 0 microversion: 2.20 time: 0.386935 May 25 17:14:41.653838 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 377/724] 10.222.0.31 () {62 vars in 1318 bytes} [Wed May 25 17:14:41 2022] POST /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 17:14:41.659264 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-aa852655-2765-403e-bc57-b76bfca01bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:41.667628 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-aa852655-2765-403e-bc57-b76bfca01bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:41.676219 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aa852655-2765-403e-bc57-b76bfca01bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:41.676970 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aa852655-2765-403e-bc57-b76bfca01bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:41.677950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aa852655-2765-403e-bc57-b76bfca01bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:41.680090 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aa852655-2765-403e-bc57-b76bfca01bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:41.704028 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-157c0132-0e2e-40b0-83d4-ad40b0d0f156 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:41.714092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-157c0132-0e2e-40b0-83d4-ad40b0d0f156 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.507624 May 25 17:14:41.721921 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 348/725] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:41 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:41.728125 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-897fbd41-6eb7-4bbb-89a0-467eff5435ae tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:41.732505 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-897fbd41-6eb7-4bbb-89a0-467eff5435ae tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:41.744787 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-897fbd41-6eb7-4bbb-89a0-467eff5435ae tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:41.746185 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-897fbd41-6eb7-4bbb-89a0-467eff5435ae tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:41.747083 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-897fbd41-6eb7-4bbb-89a0-467eff5435ae tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:41.749162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-897fbd41-6eb7-4bbb-89a0-467eff5435ae tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:41.827969 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-aa852655-2765-403e-bc57-b76bfca01bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:41.838560 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-aa852655-2765-403e-bc57-b76bfca01bb8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 200 len: 1614 microversion: 2.1 time: 0.183421 May 25 17:14:41.839366 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 378/726] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:41 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 1614 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:42.049817 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-897fbd41-6eb7-4bbb-89a0-467eff5435ae tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:42.064322 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-897fbd41-6eb7-4bbb-89a0-467eff5435ae tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:42.066779 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-897fbd41-6eb7-4bbb-89a0-467eff5435ae tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:42.073359 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-897fbd41-6eb7-4bbb-89a0-467eff5435ae tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.345363 May 25 17:14:42.085005 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-c9d1292b-9e78-402e-bfe9-ea415e883e5d req-5c2713b0-a0e6-4923-bb74-24977001291a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d856fd3d-ee9c-45ec-b4a1-46789378a5ef", "name": "network-vif-deleted", "tag": "df2173ff-664e-43ca-b7a5-ee5bf4830547"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:42.087303 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 349/727] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:41 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:42.103736 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-c9d1292b-9e78-402e-bfe9-ea415e883e5d req-5c2713b0-a0e6-4923-bb74-24977001291a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:42.104666 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-c9d1292b-9e78-402e-bfe9-ea415e883e5d req-5c2713b0-a0e6-4923-bb74-24977001291a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:42.144914 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-c9d1292b-9e78-402e-bfe9-ea415e883e5d req-5c2713b0-a0e6-4923-bb74-24977001291a service nova] Creating event network-vif-deleted:df2173ff-664e-43ca-b7a5-ee5bf4830547 for instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef on hv-cinder-84330 May 25 17:14:42.162128 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-c9d1292b-9e78-402e-bfe9-ea415e883e5d req-5c2713b0-a0e6-4923-bb74-24977001291a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081288 May 25 17:14:42.166047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 379/728] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:42.739764 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-38f27bf8-5518-4e9c-9ebb-6901ea29488f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:42.741022 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-38f27bf8-5518-4e9c-9ebb-6901ea29488f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:42.748235 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38f27bf8-5518-4e9c-9ebb-6901ea29488f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:42.748990 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38f27bf8-5518-4e9c-9ebb-6901ea29488f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:42.749938 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38f27bf8-5518-4e9c-9ebb-6901ea29488f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:42.750386 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38f27bf8-5518-4e9c-9ebb-6901ea29488f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:42.863714 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f5c731df-775a-4993-b80e-b10284d97f0c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:42.865586 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f5c731df-775a-4993-b80e-b10284d97f0c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:42.877292 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f5c731df-775a-4993-b80e-b10284d97f0c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:42.877783 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f5c731df-775a-4993-b80e-b10284d97f0c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:42.878600 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f5c731df-775a-4993-b80e-b10284d97f0c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:42.881342 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f5c731df-775a-4993-b80e-b10284d97f0c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:42.908627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-f5c731df-775a-4993-b80e-b10284d97f0c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f5c731df-775a-4993-b80e-b10284d97f0c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef HTTP/1.1 May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:14:42.910672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:14:42.911987 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': 'd856fd3d-ee9c-45ec-b4a1-46789378a5ef'} May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:14:42.912701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:14:42.917573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:14:42.918833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f5c731df-775a-4993-b80e-b10284d97f0c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:14:42.918833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f5c731df-775a-4993-b80e-b10284d97f0c tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 404 len: 111 microversion: 2.1 time: 0.060324 May 25 17:14:42.918833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 380/729] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:42 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:14:42.922738 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9f38bff2-8952-4ee5-8957-605cc562a1f2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '.version_select at 0x7f3d4e0bd8b0>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:42.929040 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-38f27bf8-5518-4e9c-9ebb-6901ea29488f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:42.938478 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-38f27bf8-5518-4e9c-9ebb-6901ea29488f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.202974 May 25 17:14:42.940427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 350/730] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:42 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:42.955033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9f38bff2-8952-4ee5-8957-605cc562a1f2 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806057832" status: 202 len: 0 microversion: 2.1 time: 0.037304 May 25 17:14:42.955711 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 381/731] 10.222.0.31 () {58 vars in 1220 bytes} [Wed May 25 17:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806057832 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:14:43.093865 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-59b54b8c-c9c1-4036-9d24-53abec0569c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:43.094477 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-59b54b8c-c9c1-4036-9d24-53abec0569c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:43.100981 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-59b54b8c-c9c1-4036-9d24-53abec0569c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:43.101658 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-59b54b8c-c9c1-4036-9d24-53abec0569c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:43.102460 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-59b54b8c-c9c1-4036-9d24-53abec0569c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:43.102937 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-59b54b8c-c9c1-4036-9d24-53abec0569c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:43.312438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-59b54b8c-c9c1-4036-9d24-53abec0569c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:43.322375 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-59b54b8c-c9c1-4036-9d24-53abec0569c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:43.324183 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-59b54b8c-c9c1-4036-9d24-53abec0569c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:43.325835 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-59b54b8c-c9c1-4036-9d24-53abec0569c3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.236915 May 25 17:14:43.338794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 351/732] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:43 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:14:43.746619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-42f6d5b6-30d1-4692-a148-ff63f1cbeeae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: .version_select at 0x7f3d4e0f6c10>, body: {"keypair": {"name": "tempest-keypair-1002748408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcQ4lZ1q24Z/uc1Cgu/EjauYgWiwO6TfRh2VCooLg1RX7DhOwSU4wtKQf4zN8L/sYYuWCC3+WRCV5aQ8uCCLid4UAsKqp5bBL7MuAYeRO0DoInUk0dl7INNAuf2hpcSKw=="}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:43.751979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:43.766983 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-42f6d5b6-30d1-4692-a148-ff63f1cbeeae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:14:43.771053 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-42f6d5b6-30d1-4692-a148-ff63f1cbeeae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for user 3fb5eecf3e244058905ea3aba8112320 and project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:14:43.793928 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-42f6d5b6-30d1-4692-a148-ff63f1cbeeae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052516 May 25 17:14:43.794594 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 382/733] 10.222.0.31 () {60 vars in 1158 bytes} [Wed May 25 17:14:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:43.956723 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c650f414-b4db-48c7-bee8-b1d11e4417ca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:43.958041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c650f414-b4db-48c7-bee8-b1d11e4417ca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:43.965463 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c650f414-b4db-48c7-bee8-b1d11e4417ca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:43.966210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c650f414-b4db-48c7-bee8-b1d11e4417ca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:43.967206 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c650f414-b4db-48c7-bee8-b1d11e4417ca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:43.967801 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c650f414-b4db-48c7-bee8-b1d11e4417ca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:44.169557 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c650f414-b4db-48c7-bee8-b1d11e4417ca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:44.179370 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c650f414-b4db-48c7-bee8-b1d11e4417ca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.226379 May 25 17:14:44.180647 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 352/734] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:43 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:44.344894 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b0044cab-50b4-4a00-80f2-d2f54607ddd7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:44.345644 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b0044cab-50b4-4a00-80f2-d2f54607ddd7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:44.353042 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b0044cab-50b4-4a00-80f2-d2f54607ddd7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:44.353790 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b0044cab-50b4-4a00-80f2-d2f54607ddd7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:44.354797 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b0044cab-50b4-4a00-80f2-d2f54607ddd7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:44.355462 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b0044cab-50b4-4a00-80f2-d2f54607ddd7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:44.600889 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b0044cab-50b4-4a00-80f2-d2f54607ddd7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:44.609744 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b0044cab-50b4-4a00-80f2-d2f54607ddd7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:44.611240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b0044cab-50b4-4a00-80f2-d2f54607ddd7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:44.612383 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b0044cab-50b4-4a00-80f2-d2f54607ddd7 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.271652 May 25 17:14:44.612963 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 383/735] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:44 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:45.188558 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6e14b482-b060-469f-9c1c-f4a34c501902 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:45.189114 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6e14b482-b060-469f-9c1c-f4a34c501902 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:45.209984 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e14b482-b060-469f-9c1c-f4a34c501902 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:45.209984 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e14b482-b060-469f-9c1c-f4a34c501902 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:45.209984 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e14b482-b060-469f-9c1c-f4a34c501902 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:45.211734 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d0e3f602-5eb4-49d3-b628-606a4182f832 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:45.211844 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e14b482-b060-469f-9c1c-f4a34c501902 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:45.211950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d0e3f602-5eb4-49d3-b628-606a4182f832 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:45.211950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d0e3f602-5eb4-49d3-b628-606a4182f832 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:45.211950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d0e3f602-5eb4-49d3-b628-606a4182f832 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:45.211950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d0e3f602-5eb4-49d3-b628-606a4182f832 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:45.212275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d0e3f602-5eb4-49d3-b628-606a4182f832 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:45.223219 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-6e14b482-b060-469f-9c1c-f4a34c501902 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lazy-loading 'flavor' on Instance uuid d2b7231c-3070-4cb3-b6a2-732af750f6f4 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:14:45.300005 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6e14b482-b060-469f-9c1c-f4a34c501902 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "POST /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4/action" status: 202 len: 0 microversion: 2.1 time: 0.115232 May 25 17:14:45.301529 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 353/736] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:14:45 2022] POST /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:14:45.311938 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b966cf63-5cf7-4adc-ba62-ec72d9d4797e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:45.312655 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b966cf63-5cf7-4adc-ba62-ec72d9d4797e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:45.322737 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b966cf63-5cf7-4adc-ba62-ec72d9d4797e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:45.322737 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b966cf63-5cf7-4adc-ba62-ec72d9d4797e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:45.324136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b966cf63-5cf7-4adc-ba62-ec72d9d4797e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:45.324790 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b966cf63-5cf7-4adc-ba62-ec72d9d4797e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:45.381479 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d0e3f602-5eb4-49d3-b628-606a4182f832 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:45.393173 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d0e3f602-5eb4-49d3-b628-606a4182f832 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.198970 May 25 17:14:45.394075 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 384/737] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:45 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:45.399827 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1055623513", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94689dfe-6d66-4ed0-9452-eee0a515d2d3"}], "security_groups": [{"name": "tempest-securitygroup--1746636054"}], "key_name": "tempest-keypair-1002748408", "user_data": "}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:45.486720 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b966cf63-5cf7-4adc-ba62-ec72d9d4797e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:45.495573 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b966cf63-5cf7-4adc-ba62-ec72d9d4797e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.188164 May 25 17:14:45.496051 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 354/738] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:45 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:45.511424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-aaa67438-0cab-4c4d-9f9b-5a294181416f tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4ea07e50>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:45.520116 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.network.neutron [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] validate_networks() for [('94689dfe-6d66-4ed0-9452-eee0a515d2d3', None, None, None, None, None)] {{(pid=117695) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:14:45.562824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-aaa67438-0cab-4c4d-9f9b-5a294181416f tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/db777b55-a7ad-494e-b874-07e4108b312a" status: 200 len: 350 microversion: 2.1 time: 0.055914 May 25 17:14:45.563674 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 355/739] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:14:45 2022] GET /compute/v2.1/os-volumes/db777b55-a7ad-494e-b874-07e4108b312a => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:14:45.630563 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4a854434-58f1-430a-ab07-5be2ea904d5b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:45.631179 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4a854434-58f1-430a-ab07-5be2ea904d5b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:45.638309 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a854434-58f1-430a-ab07-5be2ea904d5b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:45.638772 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a854434-58f1-430a-ab07-5be2ea904d5b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:45.639550 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a854434-58f1-430a-ab07-5be2ea904d5b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:45.639989 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4a854434-58f1-430a-ab07-5be2ea904d5b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:45.805150 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4a854434-58f1-430a-ab07-5be2ea904d5b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:45.814336 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4a854434-58f1-430a-ab07-5be2ea904d5b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:45.816203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4a854434-58f1-430a-ab07-5be2ea904d5b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:45.817441 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4a854434-58f1-430a-ab07-5be2ea904d5b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.190795 May 25 17:14:45.818372 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 356/740] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:45 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:14:45.949492 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Flavor limits 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:14:45.950241 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Image limits 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:14:45.951164 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Flavor pref 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:14:45.951840 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Image pref 0:0:0 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:14:45.952505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.virt.hardware [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:14:45.963816 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:45.964272 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:45.965178 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:45.966230 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:45.983919 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'ram', 'instances', 'cores'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:14:45.987898 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Getting quotas for user 3fb5eecf3e244058905ea3aba8112320 and project 6ad0c3cc9eaf41c09d6b967a2fa49900. Resources: {'ram', 'instances', 'cores'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:14:45.999678 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Going to run 1 instances... {{(pid=117695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:14:46.002071 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:14:46.048538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-172c1ab3-2f61-47fb-ae81-b49f46b8b3e8 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.653141 May 25 17:14:46.049150 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 385/741] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:14:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:14:46.059142 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e438a2e6-15a3-47da-8eb8-36f509eec5ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:46.059752 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e438a2e6-15a3-47da-8eb8-36f509eec5ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:46.113075 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e438a2e6-15a3-47da-8eb8-36f509eec5ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:46.121144 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e438a2e6-15a3-47da-8eb8-36f509eec5ae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1242 microversion: 2.1 time: 0.065732 May 25 17:14:46.121803 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 357/742] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:46 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:46.415624 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ba6be231-4905-492c-9223-a32df176fb2a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:46.416235 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ba6be231-4905-492c-9223-a32df176fb2a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:46.423059 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ba6be231-4905-492c-9223-a32df176fb2a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:46.423514 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ba6be231-4905-492c-9223-a32df176fb2a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:46.424292 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ba6be231-4905-492c-9223-a32df176fb2a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:46.424756 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ba6be231-4905-492c-9223-a32df176fb2a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:46.513579 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-674d545b-eccf-4ec8-b92d-0f66c473a4b2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:46.514192 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-674d545b-eccf-4ec8-b92d-0f66c473a4b2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:46.520929 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-674d545b-eccf-4ec8-b92d-0f66c473a4b2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:46.521616 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-674d545b-eccf-4ec8-b92d-0f66c473a4b2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:46.522392 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-674d545b-eccf-4ec8-b92d-0f66c473a4b2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:46.522834 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-674d545b-eccf-4ec8-b92d-0f66c473a4b2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:46.566062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ba6be231-4905-492c-9223-a32df176fb2a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:46.577311 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ba6be231-4905-492c-9223-a32df176fb2a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.166273 May 25 17:14:46.577992 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 386/743] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:46 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:46.672006 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-674d545b-eccf-4ec8-b92d-0f66c473a4b2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:46.680344 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-674d545b-eccf-4ec8-b92d-0f66c473a4b2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.170689 May 25 17:14:46.681043 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 358/744] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:46 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:46.835297 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-76ffd4a1-3472-4a5d-8913-c9d7857cf62f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:46.835904 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-76ffd4a1-3472-4a5d-8913-c9d7857cf62f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:46.841906 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76ffd4a1-3472-4a5d-8913-c9d7857cf62f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:46.842355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76ffd4a1-3472-4a5d-8913-c9d7857cf62f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:46.843111 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76ffd4a1-3472-4a5d-8913-c9d7857cf62f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:46.843548 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-76ffd4a1-3472-4a5d-8913-c9d7857cf62f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:46.916218 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5f39d7f6-3a63-46e5-bb20-9e49110ae34b tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4ea07160>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:46.968468 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5f39d7f6-3a63-46e5-bb20-9e49110ae34b tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/238ac745-3ae7-4489-a75c-20ef299a4e94" status: 200 len: 350 microversion: 2.1 time: 0.056641 May 25 17:14:46.974951 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 359/745] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:14:46 2022] GET /compute/v2.1/os-volumes/238ac745-3ae7-4489-a75c-20ef299a4e94 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:14:46.984467 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-76ffd4a1-3472-4a5d-8913-c9d7857cf62f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:46.996009 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-76ffd4a1-3472-4a5d-8913-c9d7857cf62f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:46.998007 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-76ffd4a1-3472-4a5d-8913-c9d7857cf62f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:46.999309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-76ffd4a1-3472-4a5d-8913-c9d7857cf62f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.167937 May 25 17:14:47.001366 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 387/746] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:46 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:47.139606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4b8db5aa-d1c6-4435-b89d-d8938155caae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:47.140220 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4b8db5aa-d1c6-4435-b89d-d8938155caae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:47.147223 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4b8db5aa-d1c6-4435-b89d-d8938155caae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:47.147657 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4b8db5aa-d1c6-4435-b89d-d8938155caae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:47.149781 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4b8db5aa-d1c6-4435-b89d-d8938155caae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:47.150476 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4b8db5aa-d1c6-4435-b89d-d8938155caae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:47.228590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4b8db5aa-d1c6-4435-b89d-d8938155caae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:47.237676 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4b8db5aa-d1c6-4435-b89d-d8938155caae tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1300 microversion: 2.1 time: 0.102350 May 25 17:14:47.238000 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 360/747] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:47 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:47.594834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5e56eb81-88a4-4bcb-9a08-c8cb0ea6691f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:47.595481 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5e56eb81-88a4-4bcb-9a08-c8cb0ea6691f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:47.602523 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5e56eb81-88a4-4bcb-9a08-c8cb0ea6691f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:47.602981 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5e56eb81-88a4-4bcb-9a08-c8cb0ea6691f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:47.603757 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5e56eb81-88a4-4bcb-9a08-c8cb0ea6691f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:47.604412 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5e56eb81-88a4-4bcb-9a08-c8cb0ea6691f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:47.698547 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c2cb6924-0f0d-4905-be4a-1c41b734c3f5 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:47.699207 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c2cb6924-0f0d-4905-be4a-1c41b734c3f5 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:47.706513 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2cb6924-0f0d-4905-be4a-1c41b734c3f5 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:47.707055 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2cb6924-0f0d-4905-be4a-1c41b734c3f5 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:47.708083 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2cb6924-0f0d-4905-be4a-1c41b734c3f5 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:47.708761 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2cb6924-0f0d-4905-be4a-1c41b734c3f5 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:47.748771 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5e56eb81-88a4-4bcb-9a08-c8cb0ea6691f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:47.756644 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5e56eb81-88a4-4bcb-9a08-c8cb0ea6691f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.165692 May 25 17:14:47.757440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 388/748] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:47 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:47.921134 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c2cb6924-0f0d-4905-be4a-1c41b734c3f5 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:47.930805 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c2cb6924-0f0d-4905-be4a-1c41b734c3f5 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.236829 May 25 17:14:47.931831 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 361/749] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:47 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:48.019330 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f2271022-1cf3-498d-9204-af58ea803f3d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:48.019938 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f2271022-1cf3-498d-9204-af58ea803f3d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:48.026286 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f2271022-1cf3-498d-9204-af58ea803f3d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:48.026742 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f2271022-1cf3-498d-9204-af58ea803f3d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:48.027508 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f2271022-1cf3-498d-9204-af58ea803f3d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:48.027942 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f2271022-1cf3-498d-9204-af58ea803f3d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:48.168515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f2271022-1cf3-498d-9204-af58ea803f3d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:48.176611 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f2271022-1cf3-498d-9204-af58ea803f3d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:48.178165 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f2271022-1cf3-498d-9204-af58ea803f3d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:48.179440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f2271022-1cf3-498d-9204-af58ea803f3d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.163971 May 25 17:14:48.180110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 389/750] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:48 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:48.254872 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-70f4aa1a-a239-45f1-ae04-8aa763b0d43b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:48.255487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-70f4aa1a-a239-45f1-ae04-8aa763b0d43b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:48.261837 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-70f4aa1a-a239-45f1-ae04-8aa763b0d43b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:48.262298 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-70f4aa1a-a239-45f1-ae04-8aa763b0d43b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:48.263071 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-70f4aa1a-a239-45f1-ae04-8aa763b0d43b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:48.263514 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-70f4aa1a-a239-45f1-ae04-8aa763b0d43b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:48.345962 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a84b8ecd-d602-41ea-a303-463dd027062b tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4e0a6af0>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:48.402625 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a84b8ecd-d602-41ea-a303-463dd027062b tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d8f92ddd-8926-47a7-9e35-b26a001b2370" status: 200 len: 351 microversion: 2.1 time: 0.060420 May 25 17:14:48.403479 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 390/751] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:14:48 2022] GET /compute/v2.1/os-volumes/d8f92ddd-8926-47a7-9e35-b26a001b2370 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:14:48.420278 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a31a5d47-aa27-4351-8eb0-2e97b1a8c7ab tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4e0bdb80>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:48.509673 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-70f4aa1a-a239-45f1-ae04-8aa763b0d43b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:48.513306 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a31a5d47-aa27-4351-8eb0-2e97b1a8c7ab tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.101731 May 25 17:14:48.513913 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 391/752] 10.222.0.31 () {58 vars in 1133 bytes} [Wed May 25 17:14:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:48.518127 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-70f4aa1a-a239-45f1-ae04-8aa763b0d43b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1368 microversion: 2.1 time: 0.267240 May 25 17:14:48.518696 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 362/753] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:48 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:48.529276 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-49f31515-2c38-49d4-b315-aead51941272 tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4e0bbc10>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:48.617523 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-49f31515-2c38-49d4-b315-aead51941272 tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095382 May 25 17:14:48.618094 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 392/754] 10.222.0.31 () {58 vars in 1148 bytes} [Wed May 25 17:14:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:48.629680 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e71f61f5-2cb0-40a2-841c-98b3e5126a3b tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4ea2cd30>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:48.672201 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-d4dffd7b-0389-403a-ac87-d355891b2465 req-a3eeba46-9a52-434f-8d62-81576530c9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22", "tag": "dedf9efc-5bd6-424a-84ab-5d5e38a62058"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:48.698234 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-d4dffd7b-0389-403a-ac87-d355891b2465 req-a3eeba46-9a52-434f-8d62-81576530c9a7 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:48.698960 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-d4dffd7b-0389-403a-ac87-d355891b2465 req-a3eeba46-9a52-434f-8d62-81576530c9a7 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:48.718462 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-d4dffd7b-0389-403a-ac87-d355891b2465 req-a3eeba46-9a52-434f-8d62-81576530c9a7 service nova] Creating event network-changed:dedf9efc-5bd6-424a-84ab-5d5e38a62058 for instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 on hv-cinder-84330 May 25 17:14:48.724260 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-d4dffd7b-0389-403a-ac87-d355891b2465 req-a3eeba46-9a52-434f-8d62-81576530c9a7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057594 May 25 17:14:48.725124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 393/755] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:48.728330 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e71f61f5-2cb0-40a2-841c-98b3e5126a3b tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.102410 May 25 17:14:48.739805 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 363/756] 10.222.0.31 () {58 vars in 1133 bytes} [Wed May 25 17:14:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:48.752775 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f380ec04-0155-468c-87c0-f0239d9ccb13 tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4e0a6dc0>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:48.775069 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0f6504a0-1e12-4e61-975c-6ce655b9bdce tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:48.776770 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0f6504a0-1e12-4e61-975c-6ce655b9bdce tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:48.790578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0f6504a0-1e12-4e61-975c-6ce655b9bdce tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:48.791186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0f6504a0-1e12-4e61-975c-6ce655b9bdce tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:48.792351 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0f6504a0-1e12-4e61-975c-6ce655b9bdce tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:48.793356 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0f6504a0-1e12-4e61-975c-6ce655b9bdce tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:48.849370 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f380ec04-0155-468c-87c0-f0239d9ccb13 tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.100927 May 25 17:14:48.850155 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 394/757] 10.222.0.31 () {58 vars in 1166 bytes} [Wed May 25 17:14:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:48.863698 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7249e9f1-2eb8-426d-8ea6-b0664c2d6032 tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4e0bdd30>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:48.969254 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7249e9f1-2eb8-426d-8ea6-b0664c2d6032 tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.110828 May 25 17:14:48.969956 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 395/758] 10.222.0.31 () {58 vars in 1169 bytes} [Wed May 25 17:14:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:48.976815 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8d936942-042d-4b32-901b-cabd87332798 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:48.977607 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8d936942-042d-4b32-901b-cabd87332798 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:48.985093 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8d936942-042d-4b32-901b-cabd87332798 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:48.985551 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8d936942-042d-4b32-901b-cabd87332798 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:48.986331 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8d936942-042d-4b32-901b-cabd87332798 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:48.986945 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8d936942-042d-4b32-901b-cabd87332798 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:49.006236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:49.085304 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0f6504a0-1e12-4e61-975c-6ce655b9bdce tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:49.095847 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0f6504a0-1e12-4e61-975c-6ce655b9bdce tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.325955 May 25 17:14:49.097204 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 364/759] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:48 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:49.103840 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8518b1a9-8244-4c58-b622-20552538d09a tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4e8ca790>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:49.145921 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8d936942-042d-4b32-901b-cabd87332798 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:49.154653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8d936942-042d-4b32-901b-cabd87332798 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.183565 May 25 17:14:49.155443 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 396/760] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:48 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:49.190781 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8518b1a9-8244-4c58-b622-20552538d09a tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.092521 May 25 17:14:49.191424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 365/761] 10.222.0.31 () {58 vars in 1154 bytes} [Wed May 25 17:14:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:49.201245 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2eea16e8-340a-4e71-b025-96d17e7ba666 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:49.201860 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2eea16e8-340a-4e71-b025-96d17e7ba666 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:49.203714 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2670a407-72ca-4ccf-b4ee-8a38f148978a tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4ea2c820>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:49.207909 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2eea16e8-340a-4e71-b025-96d17e7ba666 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:49.208365 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2eea16e8-340a-4e71-b025-96d17e7ba666 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:49.209179 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2eea16e8-340a-4e71-b025-96d17e7ba666 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:49.209602 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2eea16e8-340a-4e71-b025-96d17e7ba666 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:49.297344 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2670a407-72ca-4ccf-b4ee-8a38f148978a tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096808 May 25 17:14:49.298880 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 366/762] 10.222.0.31 () {58 vars in 1187 bytes} [Wed May 25 17:14:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:49.312809 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b580db15-936f-4d4c-8b7b-fa95714f6fb6 tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] Calling method '.version_select at 0x7f3d4ea91700>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:49.357993 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2eea16e8-340a-4e71-b025-96d17e7ba666 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:49.371122 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2eea16e8-340a-4e71-b025-96d17e7ba666 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:49.372867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2eea16e8-340a-4e71-b025-96d17e7ba666 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:49.374195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2eea16e8-340a-4e71-b025-96d17e7ba666 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.177509 May 25 17:14:49.374956 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 397/763] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:49 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:49.407511 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b580db15-936f-4d4c-8b7b-fa95714f6fb6 tempest-VolumesTestJSON-1947673985 tempest-VolumesTestJSON-1947673985-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.100083 May 25 17:14:49.408092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 367/764] 10.222.0.31 () {58 vars in 1154 bytes} [Wed May 25 17:14:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:49.535552 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a6bbffda-eae5-450c-b991-0cacb46953b1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:49.536258 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a6bbffda-eae5-450c-b991-0cacb46953b1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:49.542816 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a6bbffda-eae5-450c-b991-0cacb46953b1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:49.543271 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a6bbffda-eae5-450c-b991-0cacb46953b1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:49.544043 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a6bbffda-eae5-450c-b991-0cacb46953b1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:49.544483 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a6bbffda-eae5-450c-b991-0cacb46953b1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:49.674555 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a6bbffda-eae5-450c-b991-0cacb46953b1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:49.683462 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a6bbffda-eae5-450c-b991-0cacb46953b1 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1368 microversion: 2.1 time: 0.151727 May 25 17:14:49.684470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 398/765] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:49 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:50.113837 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e9cb5165-dada-4bea-b858-aba5b0b7d1ab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:50.114456 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e9cb5165-dada-4bea-b858-aba5b0b7d1ab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:50.121358 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e9cb5165-dada-4bea-b858-aba5b0b7d1ab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:50.121816 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e9cb5165-dada-4bea-b858-aba5b0b7d1ab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:50.122589 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e9cb5165-dada-4bea-b858-aba5b0b7d1ab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:50.123027 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e9cb5165-dada-4bea-b858-aba5b0b7d1ab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:50.127114 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:50.172788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5cb3016d-c9b2-4896-9877-1b002c8e1cf9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:50.173393 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5cb3016d-c9b2-4896-9877-1b002c8e1cf9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:50.183507 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5cb3016d-c9b2-4896-9877-1b002c8e1cf9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:50.183507 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5cb3016d-c9b2-4896-9877-1b002c8e1cf9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:50.183507 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5cb3016d-c9b2-4896-9877-1b002c8e1cf9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:50.183507 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5cb3016d-c9b2-4896-9877-1b002c8e1cf9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:50.325821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5cb3016d-c9b2-4896-9877-1b002c8e1cf9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:50.333461 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5cb3016d-c9b2-4896-9877-1b002c8e1cf9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.164698 May 25 17:14:50.334025 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 399/766] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:50 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:50.344334 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e9cb5165-dada-4bea-b858-aba5b0b7d1ab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:50.353055 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e9cb5165-dada-4bea-b858-aba5b0b7d1ab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.243516 May 25 17:14:50.353639 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 368/767] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:50 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:50.393493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5bb10742-e6be-450c-b50f-268cd31287d9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:50.394128 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5bb10742-e6be-450c-b50f-268cd31287d9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:50.401015 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5bb10742-e6be-450c-b50f-268cd31287d9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:50.401677 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5bb10742-e6be-450c-b50f-268cd31287d9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:50.402457 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5bb10742-e6be-450c-b50f-268cd31287d9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:50.402903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5bb10742-e6be-450c-b50f-268cd31287d9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:50.543120 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5bb10742-e6be-450c-b50f-268cd31287d9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:50.551791 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5bb10742-e6be-450c-b50f-268cd31287d9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:50.553894 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5bb10742-e6be-450c-b50f-268cd31287d9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:50.555620 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5bb10742-e6be-450c-b50f-268cd31287d9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.166006 May 25 17:14:50.566635 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 400/768] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:50 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:50.702085 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b34cb228-b53d-45e4-b60e-ba9cce45877d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:50.702697 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b34cb228-b53d-45e4-b60e-ba9cce45877d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:50.708814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b34cb228-b53d-45e4-b60e-ba9cce45877d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:50.709271 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b34cb228-b53d-45e4-b60e-ba9cce45877d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:50.710038 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b34cb228-b53d-45e4-b60e-ba9cce45877d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:50.710477 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b34cb228-b53d-45e4-b60e-ba9cce45877d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:50.850194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b34cb228-b53d-45e4-b60e-ba9cce45877d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:50.859052 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b34cb228-b53d-45e4-b60e-ba9cce45877d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1368 microversion: 2.1 time: 0.160921 May 25 17:14:50.859790 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 369/769] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:50 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:51.045583 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-a5a77e5b-7356-4986-8ae6-603822f19ecd req-74824804-3e17-4b60-94c8-0fba4ef5085f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48a0fde-a6e2-447e-b977-2a8d2ecca65f", "name": "network-vif-plugged", "status": "completed", "tag": "e4baaf10-25ec-45f6-8706-8a010940d744"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:51.053536 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-a5a77e5b-7356-4986-8ae6-603822f19ecd req-74824804-3e17-4b60-94c8-0fba4ef5085f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:51.053980 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-a5a77e5b-7356-4986-8ae6-603822f19ecd req-74824804-3e17-4b60-94c8-0fba4ef5085f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:51.066042 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-a5a77e5b-7356-4986-8ae6-603822f19ecd req-74824804-3e17-4b60-94c8-0fba4ef5085f service nova] Creating event network-vif-plugged:e4baaf10-25ec-45f6-8706-8a010940d744 for instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f on hv-cinder-84330 May 25 17:14:51.071873 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-a5a77e5b-7356-4986-8ae6-603822f19ecd req-74824804-3e17-4b60-94c8-0fba4ef5085f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148204 May 25 17:14:51.072447 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 401/770] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:51.351145 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cf22955d-549e-4886-afb2-2942a329fa3c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:51.351771 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cf22955d-549e-4886-afb2-2942a329fa3c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:51.358284 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf22955d-549e-4886-afb2-2942a329fa3c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:51.358730 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf22955d-549e-4886-afb2-2942a329fa3c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:51.359533 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf22955d-549e-4886-afb2-2942a329fa3c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:51.359962 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cf22955d-549e-4886-afb2-2942a329fa3c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:51.371129 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-67099cf4-411e-4138-a22d-febe24bc0013 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:51.371840 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-67099cf4-411e-4138-a22d-febe24bc0013 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:51.375105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:51.379259 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-67099cf4-411e-4138-a22d-febe24bc0013 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:51.379715 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-67099cf4-411e-4138-a22d-febe24bc0013 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:51.380500 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-67099cf4-411e-4138-a22d-febe24bc0013 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:51.380968 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-67099cf4-411e-4138-a22d-febe24bc0013 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:51.496041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cf22955d-549e-4886-afb2-2942a329fa3c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:51.503751 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cf22955d-549e-4886-afb2-2942a329fa3c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.156562 May 25 17:14:51.504581 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 370/771] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:51 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:51.523635 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-67099cf4-411e-4138-a22d-febe24bc0013 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:51.531567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-67099cf4-411e-4138-a22d-febe24bc0013 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.165188 May 25 17:14:51.532278 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 402/772] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:51 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:51.573870 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-64ac92f7-fe47-4722-9dfe-b2c57092279b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:51.574406 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-64ac92f7-fe47-4722-9dfe-b2c57092279b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:51.580426 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-64ac92f7-fe47-4722-9dfe-b2c57092279b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:51.580893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-64ac92f7-fe47-4722-9dfe-b2c57092279b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:51.581651 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-64ac92f7-fe47-4722-9dfe-b2c57092279b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:51.582086 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-64ac92f7-fe47-4722-9dfe-b2c57092279b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:51.713536 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-64ac92f7-fe47-4722-9dfe-b2c57092279b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:51.721457 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-64ac92f7-fe47-4722-9dfe-b2c57092279b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:51.723132 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-64ac92f7-fe47-4722-9dfe-b2c57092279b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:51.724391 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-64ac92f7-fe47-4722-9dfe-b2c57092279b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.154439 May 25 17:14:51.725239 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 371/773] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:51 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:51.876197 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3291eec5-5688-4208-b2f8-83aa6c7de764 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:51.876747 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3291eec5-5688-4208-b2f8-83aa6c7de764 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:51.882627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3291eec5-5688-4208-b2f8-83aa6c7de764 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:51.883246 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3291eec5-5688-4208-b2f8-83aa6c7de764 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:51.884035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3291eec5-5688-4208-b2f8-83aa6c7de764 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:51.884473 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3291eec5-5688-4208-b2f8-83aa6c7de764 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:52.014470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3291eec5-5688-4208-b2f8-83aa6c7de764 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:52.022005 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3291eec5-5688-4208-b2f8-83aa6c7de764 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1368 microversion: 2.1 time: 0.149650 May 25 17:14:52.022567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 403/774] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:51 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:52.521123 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-12be8f7a-4f4b-4036-be85-9d396e31bb73 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:52.521739 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-12be8f7a-4f4b-4036-be85-9d396e31bb73 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:52.529040 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-12be8f7a-4f4b-4036-be85-9d396e31bb73 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:52.529570 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-12be8f7a-4f4b-4036-be85-9d396e31bb73 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:52.530441 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-12be8f7a-4f4b-4036-be85-9d396e31bb73 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:52.530911 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-12be8f7a-4f4b-4036-be85-9d396e31bb73 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:52.549635 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-55193b2f-c101-4f25-b5c3-dafff7b17799 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:52.550270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-55193b2f-c101-4f25-b5c3-dafff7b17799 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:52.557478 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-55193b2f-c101-4f25-b5c3-dafff7b17799 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:52.557933 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-55193b2f-c101-4f25-b5c3-dafff7b17799 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:52.558698 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-55193b2f-c101-4f25-b5c3-dafff7b17799 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:52.559142 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-55193b2f-c101-4f25-b5c3-dafff7b17799 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:52.666222 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-12be8f7a-4f4b-4036-be85-9d396e31bb73 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:52.673946 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-12be8f7a-4f4b-4036-be85-9d396e31bb73 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.156651 May 25 17:14:52.674675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 372/775] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:52 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:52.694548 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-55193b2f-c101-4f25-b5c3-dafff7b17799 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:52.702520 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-55193b2f-c101-4f25-b5c3-dafff7b17799 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1265 microversion: 2.1 time: 0.157112 May 25 17:14:52.703098 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 404/776] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:52 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:14:52.744009 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6dfd4bfc-ab5b-4574-b575-dcbc35c884ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:52.744626 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6dfd4bfc-ab5b-4574-b575-dcbc35c884ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:52.750817 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6dfd4bfc-ab5b-4574-b575-dcbc35c884ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:52.751328 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6dfd4bfc-ab5b-4574-b575-dcbc35c884ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:52.752099 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6dfd4bfc-ab5b-4574-b575-dcbc35c884ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:52.752541 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6dfd4bfc-ab5b-4574-b575-dcbc35c884ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:52.906534 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6dfd4bfc-ab5b-4574-b575-dcbc35c884ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:52.915601 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6dfd4bfc-ab5b-4574-b575-dcbc35c884ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:52.917141 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6dfd4bfc-ab5b-4574-b575-dcbc35c884ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:52.918518 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6dfd4bfc-ab5b-4574-b575-dcbc35c884ff tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.178892 May 25 17:14:52.919779 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 373/777] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:52 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:53.041246 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-24694ab6-3091-4598-a3a5-52c867a0a68d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:53.042263 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-24694ab6-3091-4598-a3a5-52c867a0a68d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:53.049757 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-24694ab6-3091-4598-a3a5-52c867a0a68d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:53.050204 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-24694ab6-3091-4598-a3a5-52c867a0a68d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:53.050982 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-24694ab6-3091-4598-a3a5-52c867a0a68d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:53.051413 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-24694ab6-3091-4598-a3a5-52c867a0a68d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:53.195125 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-24694ab6-3091-4598-a3a5-52c867a0a68d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:53.203287 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-24694ab6-3091-4598-a3a5-52c867a0a68d tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1368 microversion: 2.1 time: 0.167790 May 25 17:14:53.204130 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 405/778] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:53 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:53.691617 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ec7d28d0-9956-459c-a012-9f1dd4234d0e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:53.692244 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ec7d28d0-9956-459c-a012-9f1dd4234d0e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:53.699854 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec7d28d0-9956-459c-a012-9f1dd4234d0e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:53.700309 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec7d28d0-9956-459c-a012-9f1dd4234d0e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:53.701125 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec7d28d0-9956-459c-a012-9f1dd4234d0e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:53.701635 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec7d28d0-9956-459c-a012-9f1dd4234d0e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:53.723626 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c5c0e130-2639-46fb-8dc0-d74c8ae14cab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:53.724293 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c5c0e130-2639-46fb-8dc0-d74c8ae14cab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:53.731545 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5c0e130-2639-46fb-8dc0-d74c8ae14cab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:53.732581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5c0e130-2639-46fb-8dc0-d74c8ae14cab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:53.733765 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5c0e130-2639-46fb-8dc0-d74c8ae14cab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:53.734799 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c5c0e130-2639-46fb-8dc0-d74c8ae14cab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:53.862257 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ec7d28d0-9956-459c-a012-9f1dd4234d0e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:53.869843 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ec7d28d0-9956-459c-a012-9f1dd4234d0e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.182181 May 25 17:14:53.870413 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 374/779] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:53 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:53.893973 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c5c0e130-2639-46fb-8dc0-d74c8ae14cab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:53.902355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c5c0e130-2639-46fb-8dc0-d74c8ae14cab tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1452 microversion: 2.1 time: 0.186888 May 25 17:14:53.903089 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 406/780] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:53 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:53.918082 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2ced4f88-61bd-43b1-b7a5-77b1b70630fa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:53.918690 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2ced4f88-61bd-43b1-b7a5-77b1b70630fa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:53.924515 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2ced4f88-61bd-43b1-b7a5-77b1b70630fa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:53.924986 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2ced4f88-61bd-43b1-b7a5-77b1b70630fa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:53.925743 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2ced4f88-61bd-43b1-b7a5-77b1b70630fa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:53.926172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2ced4f88-61bd-43b1-b7a5-77b1b70630fa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:53.943376 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-877118c1-8822-4067-b422-27bd5abf23ef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:53.944079 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-877118c1-8822-4067-b422-27bd5abf23ef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:53.952411 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-877118c1-8822-4067-b422-27bd5abf23ef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:53.953259 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-877118c1-8822-4067-b422-27bd5abf23ef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:53.954124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-877118c1-8822-4067-b422-27bd5abf23ef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:53.954641 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-877118c1-8822-4067-b422-27bd5abf23ef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:54.077369 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2ced4f88-61bd-43b1-b7a5-77b1b70630fa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:54.090022 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2ced4f88-61bd-43b1-b7a5-77b1b70630fa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1452 microversion: 2.1 time: 0.175636 May 25 17:14:54.091006 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 375/781] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:53 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:54.114265 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-877118c1-8822-4067-b422-27bd5abf23ef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:54.123304 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-877118c1-8822-4067-b422-27bd5abf23ef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:54.125098 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-877118c1-8822-4067-b422-27bd5abf23ef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:54.127306 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-877118c1-8822-4067-b422-27bd5abf23ef tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.189177 May 25 17:14:54.127854 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 407/782] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:53 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:54.222578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0433fb14-a3ef-4388-a46d-5f393e01455f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:54.223202 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0433fb14-a3ef-4388-a46d-5f393e01455f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:54.230901 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0433fb14-a3ef-4388-a46d-5f393e01455f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:54.231449 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0433fb14-a3ef-4388-a46d-5f393e01455f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:54.232806 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0433fb14-a3ef-4388-a46d-5f393e01455f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:54.233385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0433fb14-a3ef-4388-a46d-5f393e01455f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:54.416660 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0433fb14-a3ef-4388-a46d-5f393e01455f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:54.424351 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0433fb14-a3ef-4388-a46d-5f393e01455f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1368 microversion: 2.1 time: 0.207743 May 25 17:14:54.424943 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 376/783] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:54 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:54.886850 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-716c6a02-3001-41c5-841b-4efba95dc1b9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:54.888138 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-716c6a02-3001-41c5-841b-4efba95dc1b9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:54.894494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-716c6a02-3001-41c5-841b-4efba95dc1b9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:54.895117 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-716c6a02-3001-41c5-841b-4efba95dc1b9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:54.896203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-716c6a02-3001-41c5-841b-4efba95dc1b9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:54.896820 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-716c6a02-3001-41c5-841b-4efba95dc1b9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:55.020479 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-821d9bde-5a90-4f1f-a291-22439fa8ef5e req-abd78918-b517-486b-a8d1-b69469ace27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22", "name": "network-vif-plugged", "status": "completed", "tag": "dedf9efc-5bd6-424a-84ab-5d5e38a62058"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:55.033708 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-821d9bde-5a90-4f1f-a291-22439fa8ef5e req-abd78918-b517-486b-a8d1-b69469ace27f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:55.034153 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-821d9bde-5a90-4f1f-a291-22439fa8ef5e req-abd78918-b517-486b-a8d1-b69469ace27f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:55.053955 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-821d9bde-5a90-4f1f-a291-22439fa8ef5e req-abd78918-b517-486b-a8d1-b69469ace27f service nova] Creating event network-vif-plugged:dedf9efc-5bd6-424a-84ab-5d5e38a62058 for instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 on hv-cinder-84330 May 25 17:14:55.071303 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-821d9bde-5a90-4f1f-a291-22439fa8ef5e req-abd78918-b517-486b-a8d1-b69469ace27f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057426 May 25 17:14:55.081607 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 377/784] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:14:55.149367 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7b0e174e-a9da-4d43-953b-46a884861f8b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:55.150409 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7b0e174e-a9da-4d43-953b-46a884861f8b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:55.158958 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b0e174e-a9da-4d43-953b-46a884861f8b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:55.159688 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b0e174e-a9da-4d43-953b-46a884861f8b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:55.160699 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b0e174e-a9da-4d43-953b-46a884861f8b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:55.161296 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b0e174e-a9da-4d43-953b-46a884861f8b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:55.182557 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-716c6a02-3001-41c5-841b-4efba95dc1b9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:55.198827 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-716c6a02-3001-41c5-841b-4efba95dc1b9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.315708 May 25 17:14:55.199662 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 408/785] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:54 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:55.373650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7b0e174e-a9da-4d43-953b-46a884861f8b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:55.385068 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7b0e174e-a9da-4d43-953b-46a884861f8b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:55.388042 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7b0e174e-a9da-4d43-953b-46a884861f8b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:55.390375 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7b0e174e-a9da-4d43-953b-46a884861f8b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.248065 May 25 17:14:55.402834 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 378/786] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:55 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:14:55.442142 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9136b50e-5d6c-4c1a-b52d-5262bda67f74 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:55.442883 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-9136b50e-5d6c-4c1a-b52d-5262bda67f74 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:55.451393 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9136b50e-5d6c-4c1a-b52d-5262bda67f74 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:55.452164 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9136b50e-5d6c-4c1a-b52d-5262bda67f74 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:55.453711 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9136b50e-5d6c-4c1a-b52d-5262bda67f74 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:55.454260 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9136b50e-5d6c-4c1a-b52d-5262bda67f74 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:55.665479 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9136b50e-5d6c-4c1a-b52d-5262bda67f74 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:55.680553 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9136b50e-5d6c-4c1a-b52d-5262bda67f74 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1368 microversion: 2.1 time: 0.242560 May 25 17:14:55.681857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 409/787] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:55 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:56.219037 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d8ed5ce8-5d03-4290-b146-1122153f616d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:56.221055 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d8ed5ce8-5d03-4290-b146-1122153f616d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:56.224577 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:56.233487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8ed5ce8-5d03-4290-b146-1122153f616d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:56.234383 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8ed5ce8-5d03-4290-b146-1122153f616d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:56.235503 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8ed5ce8-5d03-4290-b146-1122153f616d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:56.236066 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8ed5ce8-5d03-4290-b146-1122153f616d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:56.410927 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f33e7369-4e93-443a-b72d-a4735ff2d3b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:56.411542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f33e7369-4e93-443a-b72d-a4735ff2d3b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:56.414762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:56.416288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=18 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:56.422791 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f33e7369-4e93-443a-b72d-a4735ff2d3b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:56.423454 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f33e7369-4e93-443a-b72d-a4735ff2d3b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:56.424846 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f33e7369-4e93-443a-b72d-a4735ff2d3b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:56.425436 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f33e7369-4e93-443a-b72d-a4735ff2d3b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:56.483561 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d8ed5ce8-5d03-4290-b146-1122153f616d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:56.492343 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d8ed5ce8-5d03-4290-b146-1122153f616d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.277890 May 25 17:14:56.493412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 379/788] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:56 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:56.701301 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f33e7369-4e93-443a-b72d-a4735ff2d3b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:56.711193 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f33e7369-4e93-443a-b72d-a4735ff2d3b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:56.713341 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f33e7369-4e93-443a-b72d-a4735ff2d3b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:56.714733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f33e7369-4e93-443a-b72d-a4735ff2d3b9 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.308489 May 25 17:14:56.716053 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 410/789] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:56 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:56.731505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5db8cf8b-3c26-4e62-9d24-d4be2fd47491 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:56.732511 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5db8cf8b-3c26-4e62-9d24-d4be2fd47491 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:56.739744 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5db8cf8b-3c26-4e62-9d24-d4be2fd47491 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:56.740193 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5db8cf8b-3c26-4e62-9d24-d4be2fd47491 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:56.741019 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5db8cf8b-3c26-4e62-9d24-d4be2fd47491 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:56.742034 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5db8cf8b-3c26-4e62-9d24-d4be2fd47491 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:56.849161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-e5f878b6-a793-4806-b106-92da8326bbea req-b3e63871-f638-4a6f-a37c-4680704b88b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48a0fde-a6e2-447e-b977-2a8d2ecca65f", "tag": "e4baaf10-25ec-45f6-8706-8a010940d744"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:56.858725 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-e5f878b6-a793-4806-b106-92da8326bbea req-b3e63871-f638-4a6f-a37c-4680704b88b1 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:56.859510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-e5f878b6-a793-4806-b106-92da8326bbea req-b3e63871-f638-4a6f-a37c-4680704b88b1 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:56.873059 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-e5f878b6-a793-4806-b106-92da8326bbea req-b3e63871-f638-4a6f-a37c-4680704b88b1 service nova] Creating event network-changed:e4baaf10-25ec-45f6-8706-8a010940d744 for instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f on hv-cinder-84330 May 25 17:14:56.883563 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-e5f878b6-a793-4806-b106-92da8326bbea req-b3e63871-f638-4a6f-a37c-4680704b88b1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221289 May 25 17:14:56.884531 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 380/790] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:56.932544 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5db8cf8b-3c26-4e62-9d24-d4be2fd47491 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:56.941004 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5db8cf8b-3c26-4e62-9d24-d4be2fd47491 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1368 microversion: 2.1 time: 0.223449 May 25 17:14:56.941634 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 411/791] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:56 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:57.514367 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fddf70b7-0cb0-43e9-b154-ced15f0b670e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:57.515387 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fddf70b7-0cb0-43e9-b154-ced15f0b670e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:57.523223 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fddf70b7-0cb0-43e9-b154-ced15f0b670e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:57.523909 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fddf70b7-0cb0-43e9-b154-ced15f0b670e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:57.524913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fddf70b7-0cb0-43e9-b154-ced15f0b670e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:57.525547 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fddf70b7-0cb0-43e9-b154-ced15f0b670e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:57.687646 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fddf70b7-0cb0-43e9-b154-ced15f0b670e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:57.696148 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fddf70b7-0cb0-43e9-b154-ced15f0b670e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.189953 May 25 17:14:57.697254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 381/792] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:57 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:57.734581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ef9dcc47-404c-4946-8df0-07a9896b24bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:57.735291 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ef9dcc47-404c-4946-8df0-07a9896b24bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:57.742858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ef9dcc47-404c-4946-8df0-07a9896b24bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:57.743309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ef9dcc47-404c-4946-8df0-07a9896b24bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:57.744494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ef9dcc47-404c-4946-8df0-07a9896b24bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:57.744957 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ef9dcc47-404c-4946-8df0-07a9896b24bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:57.890323 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ef9dcc47-404c-4946-8df0-07a9896b24bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:57.901993 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ef9dcc47-404c-4946-8df0-07a9896b24bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:57.903424 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ef9dcc47-404c-4946-8df0-07a9896b24bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:57.904604 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ef9dcc47-404c-4946-8df0-07a9896b24bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.174189 May 25 17:14:57.905211 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 412/793] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:57 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:57.958590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b08e3759-fbc8-4ef3-bf82-f7eb81531115 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:57.959205 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b08e3759-fbc8-4ef3-bf82-f7eb81531115 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:57.965735 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b08e3759-fbc8-4ef3-bf82-f7eb81531115 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:57.966196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b08e3759-fbc8-4ef3-bf82-f7eb81531115 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:57.966966 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b08e3759-fbc8-4ef3-bf82-f7eb81531115 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:57.967393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b08e3759-fbc8-4ef3-bf82-f7eb81531115 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:58.104403 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b08e3759-fbc8-4ef3-bf82-f7eb81531115 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:58.112223 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b08e3759-fbc8-4ef3-bf82-f7eb81531115 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1557 microversion: 2.1 time: 0.157522 May 25 17:14:58.112822 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 382/794] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:57 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:58.129279 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e0ff10db-8526-454c-b666-d8e280385956 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:58.129846 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e0ff10db-8526-454c-b666-d8e280385956 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:58.137111 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e0ff10db-8526-454c-b666-d8e280385956 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:58.137678 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e0ff10db-8526-454c-b666-d8e280385956 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:58.138448 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e0ff10db-8526-454c-b666-d8e280385956 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:58.138879 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e0ff10db-8526-454c-b666-d8e280385956 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:58.219329 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e0ff10db-8526-454c-b666-d8e280385956 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094250 May 25 17:14:58.220133 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 413/795] 10.222.0.31 () {58 vars in 1274 bytes} [Wed May 25 17:14:58 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:14:58.714377 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bb9a9a49-4e49-453c-8e8f-1055be562c47 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:58.715210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bb9a9a49-4e49-453c-8e8f-1055be562c47 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:58.722051 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bb9a9a49-4e49-453c-8e8f-1055be562c47 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:58.722613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bb9a9a49-4e49-453c-8e8f-1055be562c47 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:58.723664 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bb9a9a49-4e49-453c-8e8f-1055be562c47 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:58.724176 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bb9a9a49-4e49-453c-8e8f-1055be562c47 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:58.877195 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bb9a9a49-4e49-453c-8e8f-1055be562c47 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:58.887522 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bb9a9a49-4e49-453c-8e8f-1055be562c47 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.178087 May 25 17:14:58.888765 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 383/796] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:58 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:14:58.923934 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b83d0c39-bd91-4896-b19c-67dc4ea6de5f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:58.925309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b83d0c39-bd91-4896-b19c-67dc4ea6de5f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:58.932183 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b83d0c39-bd91-4896-b19c-67dc4ea6de5f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:58.932866 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b83d0c39-bd91-4896-b19c-67dc4ea6de5f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:58.933501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b83d0c39-bd91-4896-b19c-67dc4ea6de5f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:58.933945 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b83d0c39-bd91-4896-b19c-67dc4ea6de5f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:58.938825 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=100 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:59.249215 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b83d0c39-bd91-4896-b19c-67dc4ea6de5f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:59.261786 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b83d0c39-bd91-4896-b19c-67dc4ea6de5f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:59.263512 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b83d0c39-bd91-4896-b19c-67dc4ea6de5f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:14:59.265192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b83d0c39-bd91-4896-b19c-67dc4ea6de5f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1745 microversion: 2.20 time: 0.345361 May 25 17:14:59.265958 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 414/797] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:14:58 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1745 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:14:59.531620 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-50cd24d2-fd37-439a-801c-774a83c763cc req-10faca04-1913-4b18-bf83-0ed133b5e5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22", "tag": "dedf9efc-5bd6-424a-84ab-5d5e38a62058"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:14:59.542101 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-50cd24d2-fd37-439a-801c-774a83c763cc req-10faca04-1913-4b18-bf83-0ed133b5e5e1 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:59.542818 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-50cd24d2-fd37-439a-801c-774a83c763cc req-10faca04-1913-4b18-bf83-0ed133b5e5e1 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:59.556701 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-50cd24d2-fd37-439a-801c-774a83c763cc req-10faca04-1913-4b18-bf83-0ed133b5e5e1 service nova] Creating event network-changed:dedf9efc-5bd6-424a-84ab-5d5e38a62058 for instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 on hv-cinder-84330 May 25 17:14:59.566907 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-50cd24d2-fd37-439a-801c-774a83c763cc req-10faca04-1913-4b18-bf83-0ed133b5e5e1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039157 May 25 17:14:59.568169 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 384/798] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:14:59.906019 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-868d4c88-2362-4e3a-b241-526d1bd7b622 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:14:59.906871 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-868d4c88-2362-4e3a-b241-526d1bd7b622 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:14:59.912983 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-868d4c88-2362-4e3a-b241-526d1bd7b622 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:59.914452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-868d4c88-2362-4e3a-b241-526d1bd7b622 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:14:59.915600 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-868d4c88-2362-4e3a-b241-526d1bd7b622 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:14:59.916357 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-868d4c88-2362-4e3a-b241-526d1bd7b622 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:00.176343 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-868d4c88-2362-4e3a-b241-526d1bd7b622 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:00.185716 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-868d4c88-2362-4e3a-b241-526d1bd7b622 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1509 microversion: 2.1 time: 0.283491 May 25 17:15:00.198243 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 415/799] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:14:59 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1509 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:00.204300 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-dd9a6542-4778-4b64-81ad-96375fcb22f9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:00.205496 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-dd9a6542-4778-4b64-81ad-96375fcb22f9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:00.212614 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dd9a6542-4778-4b64-81ad-96375fcb22f9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:00.213101 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dd9a6542-4778-4b64-81ad-96375fcb22f9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:00.213880 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dd9a6542-4778-4b64-81ad-96375fcb22f9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:00.214500 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dd9a6542-4778-4b64-81ad-96375fcb22f9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:00.287053 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ba14f111-6683-4349-b0fa-c98dd77474d8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:00.289696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ba14f111-6683-4349-b0fa-c98dd77474d8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:00.301234 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ba14f111-6683-4349-b0fa-c98dd77474d8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:00.302014 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ba14f111-6683-4349-b0fa-c98dd77474d8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:00.304444 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ba14f111-6683-4349-b0fa-c98dd77474d8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:00.305155 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ba14f111-6683-4349-b0fa-c98dd77474d8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:00.315072 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:00.352855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-dd9a6542-4778-4b64-81ad-96375fcb22f9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "POST /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4/action" status: 202 len: 0 microversion: 2.1 time: 0.153471 May 25 17:15:00.356034 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 385/800] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:15:00 2022] POST /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:15:00.368110 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e2cd87da-e193-4468-8518-6f9a33417c1c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:00.370701 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e2cd87da-e193-4468-8518-6f9a33417c1c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:00.381731 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e2cd87da-e193-4468-8518-6f9a33417c1c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:00.382408 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e2cd87da-e193-4468-8518-6f9a33417c1c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:00.383878 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e2cd87da-e193-4468-8518-6f9a33417c1c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:00.384417 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e2cd87da-e193-4468-8518-6f9a33417c1c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:00.603618 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e2cd87da-e193-4468-8518-6f9a33417c1c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:00.613321 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e2cd87da-e193-4468-8518-6f9a33417c1c tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1517 microversion: 2.1 time: 0.252780 May 25 17:15:00.626305 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 386/801] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:00 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1517 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:00.844936 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ba14f111-6683-4349-b0fa-c98dd77474d8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:00.855707 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ba14f111-6683-4349-b0fa-c98dd77474d8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:00.857497 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-ba14f111-6683-4349-b0fa-c98dd77474d8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:00.859085 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ba14f111-6683-4349-b0fa-c98dd77474d8 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1745 microversion: 2.20 time: 0.577203 May 25 17:15:00.859837 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 416/802] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:00 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1745 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:15:01.633351 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7b931189-445d-4aba-bf51-c83203d493d9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:01.634124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7b931189-445d-4aba-bf51-c83203d493d9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:01.641057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b931189-445d-4aba-bf51-c83203d493d9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:01.641754 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b931189-445d-4aba-bf51-c83203d493d9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:01.642709 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b931189-445d-4aba-bf51-c83203d493d9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:01.643327 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b931189-445d-4aba-bf51-c83203d493d9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:01.839817 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7b931189-445d-4aba-bf51-c83203d493d9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:01.855219 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7b931189-445d-4aba-bf51-c83203d493d9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1519 microversion: 2.1 time: 0.225634 May 25 17:15:01.855978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 387/803] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:01 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:01.878104 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-289b0ce3-ba23-43a2-812d-c7e05d04c865 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:01.878720 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-289b0ce3-ba23-43a2-812d-c7e05d04c865 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:01.886082 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-289b0ce3-ba23-43a2-812d-c7e05d04c865 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:01.886625 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-289b0ce3-ba23-43a2-812d-c7e05d04c865 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:01.887414 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-289b0ce3-ba23-43a2-812d-c7e05d04c865 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:01.887884 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-289b0ce3-ba23-43a2-812d-c7e05d04c865 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:02.037083 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-289b0ce3-ba23-43a2-812d-c7e05d04c865 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:02.049054 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-289b0ce3-ba23-43a2-812d-c7e05d04c865 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:02.051105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-289b0ce3-ba23-43a2-812d-c7e05d04c865 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:02.053162 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-289b0ce3-ba23-43a2-812d-c7e05d04c865 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1740 microversion: 2.20 time: 0.178923 May 25 17:15:02.070720 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 417/804] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:01 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:02.872370 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8ec2855b-78c1-4b30-ab19-7df34f8ff27f tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:02.874119 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8ec2855b-78c1-4b30-ab19-7df34f8ff27f tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:02.883063 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ec2855b-78c1-4b30-ab19-7df34f8ff27f tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:02.883744 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ec2855b-78c1-4b30-ab19-7df34f8ff27f tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:02.884670 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ec2855b-78c1-4b30-ab19-7df34f8ff27f tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:02.885274 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8ec2855b-78c1-4b30-ab19-7df34f8ff27f tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:03.072961 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-92a30bfc-56c9-4079-a981-857c766b800d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:03.073679 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-92a30bfc-56c9-4079-a981-857c766b800d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:03.074380 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8ec2855b-78c1-4b30-ab19-7df34f8ff27f tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:03.083237 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8ec2855b-78c1-4b30-ab19-7df34f8ff27f tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1575 microversion: 2.1 time: 0.214797 May 25 17:15:03.083813 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 388/805] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:02 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:03.092432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92a30bfc-56c9-4079-a981-857c766b800d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:03.094405 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92a30bfc-56c9-4079-a981-857c766b800d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:03.095912 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92a30bfc-56c9-4079-a981-857c766b800d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:03.096654 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92a30bfc-56c9-4079-a981-857c766b800d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:03.170027 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-abe2c2d9-3396-4336-8985-1d7fc8f57be5 req-41a39cf9-ab7a-4ae6-b847-7500eaab381a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a32d7a-f536-4bc3-8048-cfcb457b2881", "name": "network-vif-plugged", "status": "completed", "tag": "fc8011bd-f7ca-4b39-81ab-c9bfafbcd234"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:03.195452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-abe2c2d9-3396-4336-8985-1d7fc8f57be5 req-41a39cf9-ab7a-4ae6-b847-7500eaab381a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:03.196539 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-abe2c2d9-3396-4336-8985-1d7fc8f57be5 req-41a39cf9-ab7a-4ae6-b847-7500eaab381a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:03.223514 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-abe2c2d9-3396-4336-8985-1d7fc8f57be5 req-41a39cf9-ab7a-4ae6-b847-7500eaab381a service nova] Creating event network-vif-plugged:fc8011bd-f7ca-4b39-81ab-c9bfafbcd234 for instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 on hv-cinder-84330 May 25 17:15:03.238486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-abe2c2d9-3396-4336-8985-1d7fc8f57be5 req-41a39cf9-ab7a-4ae6-b847-7500eaab381a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072767 May 25 17:15:03.239484 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 389/806] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:15:03.309129 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-92a30bfc-56c9-4079-a981-857c766b800d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:03.318647 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-92a30bfc-56c9-4079-a981-857c766b800d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:03.320866 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-92a30bfc-56c9-4079-a981-857c766b800d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:03.322599 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-92a30bfc-56c9-4079-a981-857c766b800d tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1740 microversion: 2.20 time: 0.254677 May 25 17:15:03.333862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 418/807] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:03 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:15:04.102133 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-38fcf6a0-a5de-4b03-8733-3483627a8781 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:04.103040 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-38fcf6a0-a5de-4b03-8733-3483627a8781 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:04.111130 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38fcf6a0-a5de-4b03-8733-3483627a8781 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:04.111750 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38fcf6a0-a5de-4b03-8733-3483627a8781 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:04.112549 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38fcf6a0-a5de-4b03-8733-3483627a8781 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:04.113016 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-38fcf6a0-a5de-4b03-8733-3483627a8781 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:04.273492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-38fcf6a0-a5de-4b03-8733-3483627a8781 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:04.281813 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-38fcf6a0-a5de-4b03-8733-3483627a8781 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1575 microversion: 2.1 time: 0.184475 May 25 17:15:04.293531 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 390/808] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:04 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:04.340163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-32f2ae9b-975a-4413-87d5-fd4eb13a43ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:04.340983 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-32f2ae9b-975a-4413-87d5-fd4eb13a43ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:04.349078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-32f2ae9b-975a-4413-87d5-fd4eb13a43ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:04.349702 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-32f2ae9b-975a-4413-87d5-fd4eb13a43ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:04.351122 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-32f2ae9b-975a-4413-87d5-fd4eb13a43ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:04.351662 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-32f2ae9b-975a-4413-87d5-fd4eb13a43ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:04.505378 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-32f2ae9b-975a-4413-87d5-fd4eb13a43ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:04.516733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-32f2ae9b-975a-4413-87d5-fd4eb13a43ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:04.519014 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-32f2ae9b-975a-4413-87d5-fd4eb13a43ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:04.520297 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-32f2ae9b-975a-4413-87d5-fd4eb13a43ea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1740 microversion: 2.20 time: 0.184139 May 25 17:15:04.520919 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 419/809] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:04 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:05.292492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-375c3649-143a-4b53-865f-8eae858a9173 req-260c07ee-bda3-4bb3-bfe0-ed209d8ec028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b7231c-3070-4cb3-b6a2-732af750f6f4", "name": "network-vif-unplugged", "status": "completed", "tag": "fc321a82-a17f-45cd-ae89-dea85055e57c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:05.298220 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:05.303134 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d9e3a446-1f41-40c3-801e-ab1b0dd5148a tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:05.304428 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d9e3a446-1f41-40c3-801e-ab1b0dd5148a tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:05.305795 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-375c3649-143a-4b53-865f-8eae858a9173 req-260c07ee-bda3-4bb3-bfe0-ed209d8ec028 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:05.306409 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-375c3649-143a-4b53-865f-8eae858a9173 req-260c07ee-bda3-4bb3-bfe0-ed209d8ec028 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:05.317691 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d9e3a446-1f41-40c3-801e-ab1b0dd5148a tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:05.318149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d9e3a446-1f41-40c3-801e-ab1b0dd5148a tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:05.318931 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d9e3a446-1f41-40c3-801e-ab1b0dd5148a tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:05.319856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d9e3a446-1f41-40c3-801e-ab1b0dd5148a tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:05.324150 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-375c3649-143a-4b53-865f-8eae858a9173 req-260c07ee-bda3-4bb3-bfe0-ed209d8ec028 service nova] Creating event network-vif-unplugged:fc321a82-a17f-45cd-ae89-dea85055e57c for instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 on hv-cinder-84330 May 25 17:15:05.332730 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-375c3649-143a-4b53-865f-8eae858a9173 req-260c07ee-bda3-4bb3-bfe0-ed209d8ec028 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044358 May 25 17:15:05.333640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 391/810] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:05.492992 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d9e3a446-1f41-40c3-801e-ab1b0dd5148a tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:05.505291 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d9e3a446-1f41-40c3-801e-ab1b0dd5148a tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1575 microversion: 2.1 time: 0.208549 May 25 17:15:05.505880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 420/811] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:05 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:15:05.541487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e625e057-344e-45bc-b12c-1b179e75ffaf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:05.544380 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e625e057-344e-45bc-b12c-1b179e75ffaf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:05.552604 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e625e057-344e-45bc-b12c-1b179e75ffaf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:05.553415 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e625e057-344e-45bc-b12c-1b179e75ffaf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:05.554742 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e625e057-344e-45bc-b12c-1b179e75ffaf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:05.555185 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e625e057-344e-45bc-b12c-1b179e75ffaf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:05.717433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e625e057-344e-45bc-b12c-1b179e75ffaf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:05.726786 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e625e057-344e-45bc-b12c-1b179e75ffaf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:05.728503 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e625e057-344e-45bc-b12c-1b179e75ffaf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:05.729714 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e625e057-344e-45bc-b12c-1b179e75ffaf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1740 microversion: 2.20 time: 0.194039 May 25 17:15:05.730500 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 392/812] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:05 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:06.523326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a5a0f2e0-8ea8-43dc-bea5-461fd9492ffa tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:06.524556 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a5a0f2e0-8ea8-43dc-bea5-461fd9492ffa tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:06.531303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a5a0f2e0-8ea8-43dc-bea5-461fd9492ffa tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:06.532138 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a5a0f2e0-8ea8-43dc-bea5-461fd9492ffa tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:06.533299 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a5a0f2e0-8ea8-43dc-bea5-461fd9492ffa tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:06.533967 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a5a0f2e0-8ea8-43dc-bea5-461fd9492ffa tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:06.689026 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-a5a0f2e0-8ea8-43dc-bea5-461fd9492ffa tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:06.697642 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a5a0f2e0-8ea8-43dc-bea5-461fd9492ffa tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1575 microversion: 2.1 time: 0.178861 May 25 17:15:06.698230 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 421/813] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:06 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:06.747727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9772e5e5-9468-42e8-9d5f-22a45fc0c296 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:06.748522 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9772e5e5-9468-42e8-9d5f-22a45fc0c296 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:06.756260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9772e5e5-9468-42e8-9d5f-22a45fc0c296 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:06.757364 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9772e5e5-9468-42e8-9d5f-22a45fc0c296 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:06.758145 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9772e5e5-9468-42e8-9d5f-22a45fc0c296 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:06.758577 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9772e5e5-9468-42e8-9d5f-22a45fc0c296 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:06.909196 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9772e5e5-9468-42e8-9d5f-22a45fc0c296 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:06.918852 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9772e5e5-9468-42e8-9d5f-22a45fc0c296 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:06.920437 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9772e5e5-9468-42e8-9d5f-22a45fc0c296 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:06.921718 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9772e5e5-9468-42e8-9d5f-22a45fc0c296 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1740 microversion: 2.20 time: 0.178282 May 25 17:15:06.933300 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 393/814] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:06 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:07.715235 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-bc0ec03e-fc09-443c-91f6-8d13f3a2b32e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:07.715845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-bc0ec03e-fc09-443c-91f6-8d13f3a2b32e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:07.723030 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bc0ec03e-fc09-443c-91f6-8d13f3a2b32e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:07.723480 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bc0ec03e-fc09-443c-91f6-8d13f3a2b32e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:07.724814 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bc0ec03e-fc09-443c-91f6-8d13f3a2b32e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:07.725305 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-bc0ec03e-fc09-443c-91f6-8d13f3a2b32e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:07.864307 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-bc0ec03e-fc09-443c-91f6-8d13f3a2b32e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:07.873313 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-bc0ec03e-fc09-443c-91f6-8d13f3a2b32e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1575 microversion: 2.1 time: 0.161820 May 25 17:15:07.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 422/815] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:07 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:07.941244 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-de93b924-464d-457c-8fe2-c1de7e8ce111 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:07.942047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-de93b924-464d-457c-8fe2-c1de7e8ce111 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:07.948992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de93b924-464d-457c-8fe2-c1de7e8ce111 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:07.949448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de93b924-464d-457c-8fe2-c1de7e8ce111 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:07.950433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de93b924-464d-457c-8fe2-c1de7e8ce111 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:07.951044 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-de93b924-464d-457c-8fe2-c1de7e8ce111 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:08.091993 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-de93b924-464d-457c-8fe2-c1de7e8ce111 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:08.101517 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-de93b924-464d-457c-8fe2-c1de7e8ce111 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:08.103056 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-de93b924-464d-457c-8fe2-c1de7e8ce111 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:08.104426 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-de93b924-464d-457c-8fe2-c1de7e8ce111 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1740 microversion: 2.20 time: 0.167358 May 25 17:15:08.105034 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 394/816] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:07 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:08.895436 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7eb42ae7-6edd-4a25-939b-00f3809b4e94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:08.896841 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7eb42ae7-6edd-4a25-939b-00f3809b4e94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:08.906866 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7eb42ae7-6edd-4a25-939b-00f3809b4e94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:08.907325 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7eb42ae7-6edd-4a25-939b-00f3809b4e94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:08.908390 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7eb42ae7-6edd-4a25-939b-00f3809b4e94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:08.909289 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7eb42ae7-6edd-4a25-939b-00f3809b4e94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:09.081836 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7eb42ae7-6edd-4a25-939b-00f3809b4e94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:09.105628 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7eb42ae7-6edd-4a25-939b-00f3809b4e94 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1575 microversion: 2.1 time: 0.215189 May 25 17:15:09.112463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 423/817] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:08 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:09.126192 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-542c3f1a-af4a-4818-8d36-82c13bc55272 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:09.127993 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-542c3f1a-af4a-4818-8d36-82c13bc55272 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:09.142745 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-542c3f1a-af4a-4818-8d36-82c13bc55272 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:09.143361 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-542c3f1a-af4a-4818-8d36-82c13bc55272 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:09.144149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-542c3f1a-af4a-4818-8d36-82c13bc55272 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:09.144587 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-542c3f1a-af4a-4818-8d36-82c13bc55272 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:09.349365 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-542c3f1a-af4a-4818-8d36-82c13bc55272 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:09.367195 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-542c3f1a-af4a-4818-8d36-82c13bc55272 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:09.369608 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-542c3f1a-af4a-4818-8d36-82c13bc55272 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:09.372494 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-542c3f1a-af4a-4818-8d36-82c13bc55272 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1740 microversion: 2.20 time: 0.251939 May 25 17:15:09.372959 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 395/818] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:09 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:10.129886 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9ca3ed87-6091-47b8-a7ba-52de9faff78e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:10.130837 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-9ca3ed87-6091-47b8-a7ba-52de9faff78e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:10.139868 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9ca3ed87-6091-47b8-a7ba-52de9faff78e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:10.140322 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9ca3ed87-6091-47b8-a7ba-52de9faff78e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:10.141135 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9ca3ed87-6091-47b8-a7ba-52de9faff78e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:10.141900 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9ca3ed87-6091-47b8-a7ba-52de9faff78e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:10.323611 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9ca3ed87-6091-47b8-a7ba-52de9faff78e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:10.340002 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9ca3ed87-6091-47b8-a7ba-52de9faff78e tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1575 microversion: 2.1 time: 0.206513 May 25 17:15:10.340598 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 424/819] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:10 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:10.391598 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e1446add-1b10-4e8b-ba1b-06c76fd8fd13 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:10.392584 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e1446add-1b10-4e8b-ba1b-06c76fd8fd13 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:10.400930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e1446add-1b10-4e8b-ba1b-06c76fd8fd13 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:10.401391 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e1446add-1b10-4e8b-ba1b-06c76fd8fd13 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:10.402201 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e1446add-1b10-4e8b-ba1b-06c76fd8fd13 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:10.402993 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e1446add-1b10-4e8b-ba1b-06c76fd8fd13 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:10.564062 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e1446add-1b10-4e8b-ba1b-06c76fd8fd13 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:10.573558 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e1446add-1b10-4e8b-ba1b-06c76fd8fd13 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:10.575415 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e1446add-1b10-4e8b-ba1b-06c76fd8fd13 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:10.577567 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e1446add-1b10-4e8b-ba1b-06c76fd8fd13 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1740 microversion: 2.20 time: 0.189631 May 25 17:15:10.578162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 396/820] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:10 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:11.359519 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3b5738c2-6fc5-40c9-898b-057a0abfd757 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:11.360128 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3b5738c2-6fc5-40c9-898b-057a0abfd757 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:11.367610 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3b5738c2-6fc5-40c9-898b-057a0abfd757 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:11.368312 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3b5738c2-6fc5-40c9-898b-057a0abfd757 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:11.369195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3b5738c2-6fc5-40c9-898b-057a0abfd757 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:11.369764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3b5738c2-6fc5-40c9-898b-057a0abfd757 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:11.521735 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3b5738c2-6fc5-40c9-898b-057a0abfd757 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:11.530064 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3b5738c2-6fc5-40c9-898b-057a0abfd757 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1562 microversion: 2.1 time: 0.175981 May 25 17:15:11.530638 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 425/821] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:11 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:11.595374 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-66ded806-6ecd-48a2-8a09-f3fd327795f0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:11.595986 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-66ded806-6ecd-48a2-8a09-f3fd327795f0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:11.603191 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-66ded806-6ecd-48a2-8a09-f3fd327795f0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:11.603643 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-66ded806-6ecd-48a2-8a09-f3fd327795f0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:11.604414 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-66ded806-6ecd-48a2-8a09-f3fd327795f0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:11.604891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-66ded806-6ecd-48a2-8a09-f3fd327795f0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:11.735923 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-66ded806-6ecd-48a2-8a09-f3fd327795f0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:11.744268 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-66ded806-6ecd-48a2-8a09-f3fd327795f0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:11.746181 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-66ded806-6ecd-48a2-8a09-f3fd327795f0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:11.747428 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-66ded806-6ecd-48a2-8a09-f3fd327795f0 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1740 microversion: 2.20 time: 0.156039 May 25 17:15:11.748060 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 397/822] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:11 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:12.766492 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4a6275ad-2bcc-4e8d-935a-c3d2764ca05a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:12.767108 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4a6275ad-2bcc-4e8d-935a-c3d2764ca05a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:12.774942 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4a6275ad-2bcc-4e8d-935a-c3d2764ca05a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:12.775398 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4a6275ad-2bcc-4e8d-935a-c3d2764ca05a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:12.776186 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4a6275ad-2bcc-4e8d-935a-c3d2764ca05a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:12.776599 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4a6275ad-2bcc-4e8d-935a-c3d2764ca05a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:12.919047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4a6275ad-2bcc-4e8d-935a-c3d2764ca05a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:12.927526 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4a6275ad-2bcc-4e8d-935a-c3d2764ca05a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:12.929151 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4a6275ad-2bcc-4e8d-935a-c3d2764ca05a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:12.930440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4a6275ad-2bcc-4e8d-935a-c3d2764ca05a tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1722 microversion: 2.20 time: 0.167921 May 25 17:15:12.931088 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 426/823] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:12 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:13.143147 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-4696c997-1480-4651-86cf-85ad01a7021c req-1c85697d-9623-471e-9404-7cab586ebec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b7231c-3070-4cb3-b6a2-732af750f6f4", "name": "network-vif-plugged", "status": "completed", "tag": "fc321a82-a17f-45cd-ae89-dea85055e57c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:13.152825 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4696c997-1480-4651-86cf-85ad01a7021c req-1c85697d-9623-471e-9404-7cab586ebec3 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:13.153489 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4696c997-1480-4651-86cf-85ad01a7021c req-1c85697d-9623-471e-9404-7cab586ebec3 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:13.167253 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-4696c997-1480-4651-86cf-85ad01a7021c req-1c85697d-9623-471e-9404-7cab586ebec3 service nova] Creating event network-vif-plugged:fc321a82-a17f-45cd-ae89-dea85055e57c for instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 on hv-cinder-84330 May 25 17:15:13.172582 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-4696c997-1480-4651-86cf-85ad01a7021c req-1c85697d-9623-471e-9404-7cab586ebec3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033130 May 25 17:15:13.173719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 398/824] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:13.954988 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5c248325-e071-4bd7-a5de-0de42e68f43e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:13.955730 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5c248325-e071-4bd7-a5de-0de42e68f43e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:13.962466 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c248325-e071-4bd7-a5de-0de42e68f43e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:13.962988 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c248325-e071-4bd7-a5de-0de42e68f43e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:13.963821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c248325-e071-4bd7-a5de-0de42e68f43e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:13.964318 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5c248325-e071-4bd7-a5de-0de42e68f43e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:14.103318 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5c248325-e071-4bd7-a5de-0de42e68f43e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:14.111976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5c248325-e071-4bd7-a5de-0de42e68f43e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:14.113490 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5c248325-e071-4bd7-a5de-0de42e68f43e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:14.114637 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5c248325-e071-4bd7-a5de-0de42e68f43e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1722 microversion: 2.20 time: 0.163811 May 25 17:15:14.122996 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 427/825] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:13 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:15.136724 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f3787379-121a-42fe-8f80-38bfb099da81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:15.138103 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f3787379-121a-42fe-8f80-38bfb099da81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:15.145010 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f3787379-121a-42fe-8f80-38bfb099da81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:15.145719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f3787379-121a-42fe-8f80-38bfb099da81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:15.146502 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f3787379-121a-42fe-8f80-38bfb099da81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:15.147022 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f3787379-121a-42fe-8f80-38bfb099da81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:15.298519 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f3787379-121a-42fe-8f80-38bfb099da81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:15.308565 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f3787379-121a-42fe-8f80-38bfb099da81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:15.310346 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f3787379-121a-42fe-8f80-38bfb099da81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:15.311905 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f3787379-121a-42fe-8f80-38bfb099da81 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1725 microversion: 2.20 time: 0.181953 May 25 17:15:15.312538 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 399/826] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:15 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:15.330228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1f3522e1-67c7-422f-b4b8-e41317ad6377 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c73697f9-0cf0-4923-bfd7-19e29f3fcca7"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:15.331349 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1f3522e1-67c7-422f-b4b8-e41317ad6377 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:15.337806 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1f3522e1-67c7-422f-b4b8-e41317ad6377 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:15.338256 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1f3522e1-67c7-422f-b4b8-e41317ad6377 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:15.339018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1f3522e1-67c7-422f-b4b8-e41317ad6377 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:15.339451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1f3522e1-67c7-422f-b4b8-e41317ad6377 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:15.623037 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:15.638699 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1f3522e1-67c7-422f-b4b8-e41317ad6377 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "POST /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312428 May 25 17:15:15.639536 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 428/827] 10.222.0.31 () {62 vars in 1363 bytes} [Wed May 25 17:15:15 2022] POST /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 17:15:15.764430 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-060fd77c-012c-4714-8533-351d569306f3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:15.766874 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-060fd77c-012c-4714-8533-351d569306f3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:15.776566 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-060fd77c-012c-4714-8533-351d569306f3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:15.777226 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-060fd77c-012c-4714-8533-351d569306f3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:15.778621 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-060fd77c-012c-4714-8533-351d569306f3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:15.779556 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-060fd77c-012c-4714-8533-351d569306f3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:16.039407 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-060fd77c-012c-4714-8533-351d569306f3 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "DELETE /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/os-volume_attachments/c73697f9-0cf0-4923-bfd7-19e29f3fcca7" status: 202 len: 0 microversion: 2.20 time: 0.281504 May 25 17:15:16.040029 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 400/828] 10.222.0.31 () {60 vars in 1456 bytes} [Wed May 25 17:15:15 2022] DELETE /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/os-volume_attachments/c73697f9-0cf0-4923-bfd7-19e29f3fcca7 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 17:15:16.099391 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-49a2f030-a222-4d4c-b9d8-0eb88477c3d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:16.100537 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-49a2f030-a222-4d4c-b9d8-0eb88477c3d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:16.106660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-49a2f030-a222-4d4c-b9d8-0eb88477c3d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:16.107113 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-49a2f030-a222-4d4c-b9d8-0eb88477c3d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:16.107879 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-49a2f030-a222-4d4c-b9d8-0eb88477c3d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:16.108320 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-49a2f030-a222-4d4c-b9d8-0eb88477c3d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:16.207876 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-49a2f030-a222-4d4c-b9d8-0eb88477c3d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "POST /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/action" status: 202 len: 0 microversion: 2.20 time: 0.112345 May 25 17:15:16.208485 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 429/829] 10.222.0.31 () {62 vars in 1318 bytes} [Wed May 25 17:15:16 2022] POST /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 17:15:16.217972 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-eb0a4ea8-2438-4afb-9076-aef451d28b1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:16.218676 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-eb0a4ea8-2438-4afb-9076-aef451d28b1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:16.227702 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb0a4ea8-2438-4afb-9076-aef451d28b1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:16.228853 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb0a4ea8-2438-4afb-9076-aef451d28b1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:16.229884 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb0a4ea8-2438-4afb-9076-aef451d28b1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:16.230427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb0a4ea8-2438-4afb-9076-aef451d28b1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:16.369018 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-eb0a4ea8-2438-4afb-9076-aef451d28b1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:16.377245 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-eb0a4ea8-2438-4afb-9076-aef451d28b1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:16.378771 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-eb0a4ea8-2438-4afb-9076-aef451d28b1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:16.379938 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-eb0a4ea8-2438-4afb-9076-aef451d28b1f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1673 microversion: 2.20 time: 0.166699 May 25 17:15:16.380504 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 401/830] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:16 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:15:16.903936 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-07da5cca-8498-40b3-8a37-a9ffc4a9385a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:16.904443 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-07da5cca-8498-40b3-8a37-a9ffc4a9385a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:16.911772 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07da5cca-8498-40b3-8a37-a9ffc4a9385a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:16.912236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07da5cca-8498-40b3-8a37-a9ffc4a9385a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:16.914039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07da5cca-8498-40b3-8a37-a9ffc4a9385a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:16.914690 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-07da5cca-8498-40b3-8a37-a9ffc4a9385a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:16.943192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-07da5cca-8498-40b3-8a37-a9ffc4a9385a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/ips" status: 200 len: 144 microversion: 2.1 time: 0.042695 May 25 17:15:16.950304 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 430/831] 10.222.0.31 () {58 vars in 1247 bytes} [Wed May 25 17:15:16 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:17.172292 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-00b2168a-eb69-4cee-b1e4-76b9498430d4 req-9bc6fe34-cdee-47c7-bf3a-590fc60bf9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a32d7a-f536-4bc3-8048-cfcb457b2881", "name": "network-vif-unplugged", "status": "completed", "tag": "fc8011bd-f7ca-4b39-81ab-c9bfafbcd234"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:17.183632 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-00b2168a-eb69-4cee-b1e4-76b9498430d4 req-9bc6fe34-cdee-47c7-bf3a-590fc60bf9bd service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:17.184573 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-00b2168a-eb69-4cee-b1e4-76b9498430d4 req-9bc6fe34-cdee-47c7-bf3a-590fc60bf9bd service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:17.189645 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:17.211110 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.compute.server_external_events [req-00b2168a-eb69-4cee-b1e4-76b9498430d4 req-9bc6fe34-cdee-47c7-bf3a-590fc60bf9bd service nova] Unable to find a host for instance 64a32d7a-f536-4bc3-8048-cfcb457b2881. Dropping event network-vif-unplugged {{(pid=117696) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 17:15:17.212186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-00b2168a-eb69-4cee-b1e4-76b9498430d4 req-9bc6fe34-cdee-47c7-bf3a-590fc60bf9bd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050053 May 25 17:15:17.213452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 402/832] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 25 17:15:17.398389 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-92fd1e81-922a-44a8-b468-5d16484a0d36 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:17.399003 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-92fd1e81-922a-44a8-b468-5d16484a0d36 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:17.405046 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92fd1e81-922a-44a8-b468-5d16484a0d36 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:17.405500 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92fd1e81-922a-44a8-b468-5d16484a0d36 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:17.406270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92fd1e81-922a-44a8-b468-5d16484a0d36 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:17.406717 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-92fd1e81-922a-44a8-b468-5d16484a0d36 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:17.550192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-92fd1e81-922a-44a8-b468-5d16484a0d36 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:17.558810 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-92fd1e81-922a-44a8-b468-5d16484a0d36 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:17.560318 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-92fd1e81-922a-44a8-b468-5d16484a0d36 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:17.561764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-92fd1e81-922a-44a8-b468-5d16484a0d36 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1675 microversion: 2.20 time: 0.167313 May 25 17:15:17.562320 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 431/833] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:17 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:18.351893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-52dd4d8f-e2cc-4818-8127-6fe74896ef11 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae7fffb8-1456-425d-927a-da5997a77e2b"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:18.353837 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-52dd4d8f-e2cc-4818-8127-6fe74896ef11 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:18.364637 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-52dd4d8f-e2cc-4818-8127-6fe74896ef11 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:18.366423 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-52dd4d8f-e2cc-4818-8127-6fe74896ef11 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:18.367772 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-52dd4d8f-e2cc-4818-8127-6fe74896ef11 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:18.368225 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-52dd4d8f-e2cc-4818-8127-6fe74896ef11 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:18.582037 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7c78c14c-5d6f-4d81-a782-c97c99ae54ac tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:18.582782 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7c78c14c-5d6f-4d81-a782-c97c99ae54ac tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:18.590392 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7c78c14c-5d6f-4d81-a782-c97c99ae54ac tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:18.591103 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7c78c14c-5d6f-4d81-a782-c97c99ae54ac tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:18.591871 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7c78c14c-5d6f-4d81-a782-c97c99ae54ac tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:18.592478 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7c78c14c-5d6f-4d81-a782-c97c99ae54ac tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:18.774679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-52dd4d8f-e2cc-4818-8127-6fe74896ef11 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427602 May 25 17:15:18.775723 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 403/834] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:15:18 2022] POST /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:18.789697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7c78c14c-5d6f-4d81-a782-c97c99ae54ac tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:18.805384 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7c78c14c-5d6f-4d81-a782-c97c99ae54ac tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:18.814046 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7c78c14c-5d6f-4d81-a782-c97c99ae54ac tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:18.815270 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7c78c14c-5d6f-4d81-a782-c97c99ae54ac tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.237266 May 25 17:15:18.815837 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 432/835] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:18 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:15:19.835348 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5ebe3766-b6f4-472d-a6b6-12cab348753e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:19.836059 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5ebe3766-b6f4-472d-a6b6-12cab348753e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:19.843368 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ebe3766-b6f4-472d-a6b6-12cab348753e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:19.845888 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ebe3766-b6f4-472d-a6b6-12cab348753e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:19.852774 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ebe3766-b6f4-472d-a6b6-12cab348753e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:19.853386 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ebe3766-b6f4-472d-a6b6-12cab348753e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:20.064025 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ebe3766-b6f4-472d-a6b6-12cab348753e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:20.074306 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ebe3766-b6f4-472d-a6b6-12cab348753e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:20.076190 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ebe3766-b6f4-472d-a6b6-12cab348753e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:20.077582 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5ebe3766-b6f4-472d-a6b6-12cab348753e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.247869 May 25 17:15:20.078600 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 404/836] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:19 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:21.097064 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-425ce635-581f-4a0e-9e70-d1d10313d6b6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:21.097684 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-425ce635-581f-4a0e-9e70-d1d10313d6b6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:21.113562 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-425ce635-581f-4a0e-9e70-d1d10313d6b6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:21.114256 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-425ce635-581f-4a0e-9e70-d1d10313d6b6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:21.115181 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-425ce635-581f-4a0e-9e70-d1d10313d6b6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:21.116302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-425ce635-581f-4a0e-9e70-d1d10313d6b6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:21.301569 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-425ce635-581f-4a0e-9e70-d1d10313d6b6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:21.311487 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-425ce635-581f-4a0e-9e70-d1d10313d6b6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:21.313061 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-425ce635-581f-4a0e-9e70-d1d10313d6b6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:21.314240 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-425ce635-581f-4a0e-9e70-d1d10313d6b6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.221369 May 25 17:15:21.314840 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 433/837] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:21 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:22.333565 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4f448a38-a43d-4783-97a6-6881f55c2ebd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:22.334954 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4f448a38-a43d-4783-97a6-6881f55c2ebd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:22.342303 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f448a38-a43d-4783-97a6-6881f55c2ebd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:22.342758 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f448a38-a43d-4783-97a6-6881f55c2ebd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:22.343574 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f448a38-a43d-4783-97a6-6881f55c2ebd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:22.344016 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f448a38-a43d-4783-97a6-6881f55c2ebd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:22.482797 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4f448a38-a43d-4783-97a6-6881f55c2ebd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:22.491607 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4f448a38-a43d-4783-97a6-6881f55c2ebd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:22.493183 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4f448a38-a43d-4783-97a6-6881f55c2ebd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:22.494369 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4f448a38-a43d-4783-97a6-6881f55c2ebd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.164831 May 25 17:15:22.494938 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 405/838] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:22 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:23.513493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3c5efd2f-f70e-4fd9-80c0-08d96f807a2c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:23.514170 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3c5efd2f-f70e-4fd9-80c0-08d96f807a2c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:23.516509 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=65 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:23.523528 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c5efd2f-f70e-4fd9-80c0-08d96f807a2c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:23.524115 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c5efd2f-f70e-4fd9-80c0-08d96f807a2c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:23.525179 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c5efd2f-f70e-4fd9-80c0-08d96f807a2c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:23.525717 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c5efd2f-f70e-4fd9-80c0-08d96f807a2c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:23.677026 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3c5efd2f-f70e-4fd9-80c0-08d96f807a2c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:23.686658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3c5efd2f-f70e-4fd9-80c0-08d96f807a2c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:23.688168 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3c5efd2f-f70e-4fd9-80c0-08d96f807a2c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:23.689366 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3c5efd2f-f70e-4fd9-80c0-08d96f807a2c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.180076 May 25 17:15:23.689927 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 434/839] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:23 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:15:24.713949 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-252adfa3-1420-4a71-8116-560b7a57260b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:24.715463 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-252adfa3-1420-4a71-8116-560b7a57260b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:24.722673 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-252adfa3-1420-4a71-8116-560b7a57260b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:24.723325 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-252adfa3-1420-4a71-8116-560b7a57260b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:24.724102 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-252adfa3-1420-4a71-8116-560b7a57260b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:24.725162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-252adfa3-1420-4a71-8116-560b7a57260b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:24.911561 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-252adfa3-1420-4a71-8116-560b7a57260b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:24.923189 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-252adfa3-1420-4a71-8116-560b7a57260b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:24.925749 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-252adfa3-1420-4a71-8116-560b7a57260b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:24.927424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-252adfa3-1420-4a71-8116-560b7a57260b tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.220483 May 25 17:15:24.929743 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 406/840] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:24 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:25.948225 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-18ac0803-c9dc-4606-8c1a-d410371228a1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:25.948842 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-18ac0803-c9dc-4606-8c1a-d410371228a1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:25.955473 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-18ac0803-c9dc-4606-8c1a-d410371228a1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:25.955922 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-18ac0803-c9dc-4606-8c1a-d410371228a1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:25.956700 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-18ac0803-c9dc-4606-8c1a-d410371228a1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:25.957274 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-18ac0803-c9dc-4606-8c1a-d410371228a1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:26.107761 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-18ac0803-c9dc-4606-8c1a-d410371228a1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:26.117454 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-18ac0803-c9dc-4606-8c1a-d410371228a1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:26.118970 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-18ac0803-c9dc-4606-8c1a-d410371228a1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:26.120141 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-18ac0803-c9dc-4606-8c1a-d410371228a1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.176897 May 25 17:15:26.120725 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 435/841] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:25 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:27.138001 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8bcf82db-b508-478a-9491-c3f5eda72934 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:27.138679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8bcf82db-b508-478a-9491-c3f5eda72934 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:27.145729 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8bcf82db-b508-478a-9491-c3f5eda72934 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:27.146186 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8bcf82db-b508-478a-9491-c3f5eda72934 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:27.147806 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8bcf82db-b508-478a-9491-c3f5eda72934 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:27.148248 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8bcf82db-b508-478a-9491-c3f5eda72934 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:27.299042 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8bcf82db-b508-478a-9491-c3f5eda72934 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:27.307539 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8bcf82db-b508-478a-9491-c3f5eda72934 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:27.309087 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8bcf82db-b508-478a-9491-c3f5eda72934 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:27.310266 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8bcf82db-b508-478a-9491-c3f5eda72934 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.176322 May 25 17:15:27.311087 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 407/842] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:27 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:28.330310 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0e3920f7-26d9-4811-93a6-4c8de6d2c579 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:28.330927 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0e3920f7-26d9-4811-93a6-4c8de6d2c579 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:28.338625 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e3920f7-26d9-4811-93a6-4c8de6d2c579 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:28.339082 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e3920f7-26d9-4811-93a6-4c8de6d2c579 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:28.339853 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e3920f7-26d9-4811-93a6-4c8de6d2c579 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:28.340292 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e3920f7-26d9-4811-93a6-4c8de6d2c579 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:28.473229 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0e3920f7-26d9-4811-93a6-4c8de6d2c579 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:28.481215 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0e3920f7-26d9-4811-93a6-4c8de6d2c579 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:28.482724 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0e3920f7-26d9-4811-93a6-4c8de6d2c579 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:28.483893 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0e3920f7-26d9-4811-93a6-4c8de6d2c579 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.157669 May 25 17:15:28.484484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 436/843] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:28 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:29.501875 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4aa853bf-8f74-4c07-8839-179a7269f470 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:29.502492 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4aa853bf-8f74-4c07-8839-179a7269f470 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:29.509477 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4aa853bf-8f74-4c07-8839-179a7269f470 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:29.509891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4aa853bf-8f74-4c07-8839-179a7269f470 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:29.510661 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4aa853bf-8f74-4c07-8839-179a7269f470 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:29.511105 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4aa853bf-8f74-4c07-8839-179a7269f470 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:29.642183 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4aa853bf-8f74-4c07-8839-179a7269f470 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:29.650140 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4aa853bf-8f74-4c07-8839-179a7269f470 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:29.651661 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4aa853bf-8f74-4c07-8839-179a7269f470 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:29.652853 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4aa853bf-8f74-4c07-8839-179a7269f470 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.154958 May 25 17:15:29.653501 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 408/844] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:29 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:30.671922 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7a96f221-fe4c-4bc2-b516-5997afb209e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:30.672602 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7a96f221-fe4c-4bc2-b516-5997afb209e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:30.679550 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a96f221-fe4c-4bc2-b516-5997afb209e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:30.679795 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a96f221-fe4c-4bc2-b516-5997afb209e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:30.680566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a96f221-fe4c-4bc2-b516-5997afb209e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:30.681035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7a96f221-fe4c-4bc2-b516-5997afb209e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:30.810948 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7a96f221-fe4c-4bc2-b516-5997afb209e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:30.819380 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7a96f221-fe4c-4bc2-b516-5997afb209e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:30.820835 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7a96f221-fe4c-4bc2-b516-5997afb209e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:30.821976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7a96f221-fe4c-4bc2-b516-5997afb209e6 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.153979 May 25 17:15:30.822522 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 437/845] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:30 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:31.840156 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cebea308-401c-481e-94f5-980fe50cd655 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:31.840799 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cebea308-401c-481e-94f5-980fe50cd655 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:31.847284 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cebea308-401c-481e-94f5-980fe50cd655 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:31.847736 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cebea308-401c-481e-94f5-980fe50cd655 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:31.848495 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cebea308-401c-481e-94f5-980fe50cd655 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:31.848960 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cebea308-401c-481e-94f5-980fe50cd655 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:31.986611 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cebea308-401c-481e-94f5-980fe50cd655 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:31.994683 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cebea308-401c-481e-94f5-980fe50cd655 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:31.996191 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cebea308-401c-481e-94f5-980fe50cd655 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:31.997384 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cebea308-401c-481e-94f5-980fe50cd655 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.161160 May 25 17:15:31.997945 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 409/846] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:31 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:33.015337 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e4ea46db-bd39-4d30-8ecc-c86bb01c3ca5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:33.015861 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e4ea46db-bd39-4d30-8ecc-c86bb01c3ca5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:33.022310 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e4ea46db-bd39-4d30-8ecc-c86bb01c3ca5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:33.022752 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e4ea46db-bd39-4d30-8ecc-c86bb01c3ca5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:33.023505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e4ea46db-bd39-4d30-8ecc-c86bb01c3ca5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:33.023935 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e4ea46db-bd39-4d30-8ecc-c86bb01c3ca5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:33.157750 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e4ea46db-bd39-4d30-8ecc-c86bb01c3ca5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:33.167221 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e4ea46db-bd39-4d30-8ecc-c86bb01c3ca5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:33.168725 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e4ea46db-bd39-4d30-8ecc-c86bb01c3ca5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:33.170156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e4ea46db-bd39-4d30-8ecc-c86bb01c3ca5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.158492 May 25 17:15:33.170714 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 438/847] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:33 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:33.270187 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-3e8ce8f7-2540-4a2d-b29d-aa0dfceea594 req-060d2404-6e15-4a54-8dfc-53c02cd5e7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a32d7a-f536-4bc3-8048-cfcb457b2881", "name": "network-vif-plugged", "status": "completed", "tag": "fc8011bd-f7ca-4b39-81ab-c9bfafbcd234"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:33.279934 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-3e8ce8f7-2540-4a2d-b29d-aa0dfceea594 req-060d2404-6e15-4a54-8dfc-53c02cd5e7ad service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:33.280376 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-3e8ce8f7-2540-4a2d-b29d-aa0dfceea594 req-060d2404-6e15-4a54-8dfc-53c02cd5e7ad service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:33.292041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-3e8ce8f7-2540-4a2d-b29d-aa0dfceea594 req-060d2404-6e15-4a54-8dfc-53c02cd5e7ad service nova] Creating event network-vif-plugged:fc8011bd-f7ca-4b39-81ab-c9bfafbcd234 for instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 on hv-cinder-84330 May 25 17:15:33.297182 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-3e8ce8f7-2540-4a2d-b29d-aa0dfceea594 req-060d2404-6e15-4a54-8dfc-53c02cd5e7ad service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030742 May 25 17:15:33.297837 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 410/848] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:34.188459 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0f78135c-a93a-4edc-8fcb-c6f28cfc6cde tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:34.189112 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0f78135c-a93a-4edc-8fcb-c6f28cfc6cde tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:34.195763 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0f78135c-a93a-4edc-8fcb-c6f28cfc6cde tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:34.196163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0f78135c-a93a-4edc-8fcb-c6f28cfc6cde tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:34.196950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0f78135c-a93a-4edc-8fcb-c6f28cfc6cde tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:34.197391 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0f78135c-a93a-4edc-8fcb-c6f28cfc6cde tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:34.482828 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0f78135c-a93a-4edc-8fcb-c6f28cfc6cde tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:34.491485 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0f78135c-a93a-4edc-8fcb-c6f28cfc6cde tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:34.493026 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-0f78135c-a93a-4edc-8fcb-c6f28cfc6cde tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:34.494182 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0f78135c-a93a-4edc-8fcb-c6f28cfc6cde tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.309946 May 25 17:15:34.494734 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 439/849] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:34 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:35.513268 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3d9cff29-3087-4cb1-94b8-490a57f93b6c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:35.514078 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3d9cff29-3087-4cb1-94b8-490a57f93b6c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:35.516111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=40 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:35.522599 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3d9cff29-3087-4cb1-94b8-490a57f93b6c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:35.523134 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3d9cff29-3087-4cb1-94b8-490a57f93b6c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:35.524048 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3d9cff29-3087-4cb1-94b8-490a57f93b6c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:35.524438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3d9cff29-3087-4cb1-94b8-490a57f93b6c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:35.656713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3d9cff29-3087-4cb1-94b8-490a57f93b6c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:35.665744 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3d9cff29-3087-4cb1-94b8-490a57f93b6c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:35.667295 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3d9cff29-3087-4cb1-94b8-490a57f93b6c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:35.668455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3d9cff29-3087-4cb1-94b8-490a57f93b6c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1731 microversion: 2.20 time: 0.160147 May 25 17:15:35.669051 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 411/850] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:35 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:36.687105 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-40f084f2-125e-4564-91d3-ecca31bcd04f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:36.687708 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-40f084f2-125e-4564-91d3-ecca31bcd04f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:36.694544 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-40f084f2-125e-4564-91d3-ecca31bcd04f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:36.695020 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-40f084f2-125e-4564-91d3-ecca31bcd04f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:36.695760 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-40f084f2-125e-4564-91d3-ecca31bcd04f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:36.696203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-40f084f2-125e-4564-91d3-ecca31bcd04f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:36.827397 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-40f084f2-125e-4564-91d3-ecca31bcd04f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:36.835699 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-40f084f2-125e-4564-91d3-ecca31bcd04f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:36.837200 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-40f084f2-125e-4564-91d3-ecca31bcd04f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:36.838334 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-40f084f2-125e-4564-91d3-ecca31bcd04f tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1718 microversion: 2.20 time: 0.155446 May 25 17:15:36.838875 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 440/851] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:15:36 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:15:37.001701 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7b61afb7-6486-4b5b-885c-abf2d7ab339b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:37.002629 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7b61afb7-6486-4b5b-885c-abf2d7ab339b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:37.009820 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b61afb7-6486-4b5b-885c-abf2d7ab339b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:37.010270 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b61afb7-6486-4b5b-885c-abf2d7ab339b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:37.011026 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b61afb7-6486-4b5b-885c-abf2d7ab339b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:37.011461 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b61afb7-6486-4b5b-885c-abf2d7ab339b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:37.041177 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7b61afb7-6486-4b5b-885c-abf2d7ab339b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 May 25 17:15:37.041732 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 412/852] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:15:36 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:37.051372 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-91d0511a-6a1f-4834-bf01-7490f3aea1b1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:37.051858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-91d0511a-6a1f-4834-bf01-7490f3aea1b1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:37.058422 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-91d0511a-6a1f-4834-bf01-7490f3aea1b1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:37.058866 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-91d0511a-6a1f-4834-bf01-7490f3aea1b1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:37.059613 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-91d0511a-6a1f-4834-bf01-7490f3aea1b1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:37.060043 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-91d0511a-6a1f-4834-bf01-7490f3aea1b1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:37.087977 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-91d0511a-6a1f-4834-bf01-7490f3aea1b1 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments/ae7fffb8-1456-425d-927a-da5997a77e2b" status: 200 len: 194 microversion: 2.1 time: 0.040441 May 25 17:15:37.088526 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 441/853] 10.222.0.31 () {58 vars in 1412 bytes} [Wed May 25 17:15:37 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments/ae7fffb8-1456-425d-927a-da5997a77e2b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:38.401693 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a3dc609d-0f89-409e-8855-ff2ca45c5f7e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd719345-12f9-4ae5-a5db-c61dd723e90e"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:38.402749 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a3dc609d-0f89-409e-8855-ff2ca45c5f7e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:38.409275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a3dc609d-0f89-409e-8855-ff2ca45c5f7e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:38.409723 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a3dc609d-0f89-409e-8855-ff2ca45c5f7e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:38.410495 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a3dc609d-0f89-409e-8855-ff2ca45c5f7e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:38.410909 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a3dc609d-0f89-409e-8855-ff2ca45c5f7e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:38.648477 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a3dc609d-0f89-409e-8855-ff2ca45c5f7e tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "POST /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250506 May 25 17:15:38.649331 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 413/854] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:15:38 2022] POST /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:44.188148 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-24809ec5-08e7-413d-b726-af25d47ddd1f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:44.188668 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-24809ec5-08e7-413d-b726-af25d47ddd1f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:44.195980 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-24809ec5-08e7-413d-b726-af25d47ddd1f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:44.196427 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-24809ec5-08e7-413d-b726-af25d47ddd1f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:44.197579 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-24809ec5-08e7-413d-b726-af25d47ddd1f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:44.198295 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-24809ec5-08e7-413d-b726-af25d47ddd1f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:44.222120 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-24809ec5-08e7-413d-b726-af25d47ddd1f tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/ips" status: 200 len: 148 microversion: 2.1 time: 0.038168 May 25 17:15:44.222687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 442/855] 10.222.0.31 () {58 vars in 1247 bytes} [Wed May 25 17:15:44 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:45.539532 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-854235f8-e315-45db-a1d2-e276f38e14c7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b072de6-7619-4415-a541-cd7de35e805c"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:45.540778 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-854235f8-e315-45db-a1d2-e276f38e14c7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:45.547651 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-854235f8-e315-45db-a1d2-e276f38e14c7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:45.548107 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-854235f8-e315-45db-a1d2-e276f38e14c7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:45.548944 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-854235f8-e315-45db-a1d2-e276f38e14c7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:45.549389 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-854235f8-e315-45db-a1d2-e276f38e14c7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:45.788459 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-854235f8-e315-45db-a1d2-e276f38e14c7 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "POST /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254658 May 25 17:15:45.789129 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 414/856] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:15:45 2022] POST /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:46.151503 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b3772dd5-210e-4825-800a-85e607002683 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:46.152491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b3772dd5-210e-4825-800a-85e607002683 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:46.158964 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b3772dd5-210e-4825-800a-85e607002683 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:46.159419 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b3772dd5-210e-4825-800a-85e607002683 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:46.160191 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b3772dd5-210e-4825-800a-85e607002683 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:46.160635 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b3772dd5-210e-4825-800a-85e607002683 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:46.165193 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:46.193937 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b3772dd5-210e-4825-800a-85e607002683 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046290 May 25 17:15:46.194390 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 443/857] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:15:46 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:46.335529 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8d2db84c-55ce-433e-a5c8-43f10c8890bc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:46.336109 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8d2db84c-55ce-433e-a5c8-43f10c8890bc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:46.342351 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8d2db84c-55ce-433e-a5c8-43f10c8890bc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:46.342805 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8d2db84c-55ce-433e-a5c8-43f10c8890bc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:46.343564 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8d2db84c-55ce-433e-a5c8-43f10c8890bc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:46.344003 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8d2db84c-55ce-433e-a5c8-43f10c8890bc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:46.373481 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8d2db84c-55ce-433e-a5c8-43f10c8890bc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments/ae7fffb8-1456-425d-927a-da5997a77e2b" status: 200 len: 194 microversion: 2.1 time: 0.043256 May 25 17:15:46.374056 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 415/858] 10.222.0.31 () {58 vars in 1412 bytes} [Wed May 25 17:15:46 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments/ae7fffb8-1456-425d-927a-da5997a77e2b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:46.383533 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8b0fc09d-b771-49f7-9d5d-b194b23e4f8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:46.384031 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8b0fc09d-b771-49f7-9d5d-b194b23e4f8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:46.390077 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8b0fc09d-b771-49f7-9d5d-b194b23e4f8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:46.390532 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8b0fc09d-b771-49f7-9d5d-b194b23e4f8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:46.391297 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8b0fc09d-b771-49f7-9d5d-b194b23e4f8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:46.391753 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8b0fc09d-b771-49f7-9d5d-b194b23e4f8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:46.471314 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-8b0fc09d-b771-49f7-9d5d-b194b23e4f8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lazy-loading 'services' on Instance uuid 3259a826-9d68-40f3-8bb5-7fbf834d3034 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:15:46.544296 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8b0fc09d-b771-49f7-9d5d-b194b23e4f8a tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments/ae7fffb8-1456-425d-927a-da5997a77e2b" status: 202 len: 0 microversion: 2.1 time: 0.164501 May 25 17:15:46.545097 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 444/859] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:15:46 2022] DELETE /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments/ae7fffb8-1456-425d-927a-da5997a77e2b => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:15:53.380527 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d74a966f-7d8a-45ab-9086-b6118d6da65a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:53.381055 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d74a966f-7d8a-45ab-9086-b6118d6da65a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:53.387644 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d74a966f-7d8a-45ab-9086-b6118d6da65a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:53.388095 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d74a966f-7d8a-45ab-9086-b6118d6da65a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:53.388897 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d74a966f-7d8a-45ab-9086-b6118d6da65a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:53.389336 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d74a966f-7d8a-45ab-9086-b6118d6da65a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:53.393218 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:53.476372 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-d74a966f-7d8a-45ab-9086-b6118d6da65a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lazy-loading 'services' on Instance uuid c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:15:53.545229 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d74a966f-7d8a-45ab-9086-b6118d6da65a tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/os-volume_attachments/4b072de6-7619-4415-a541-cd7de35e805c" status: 202 len: 0 microversion: 2.1 time: 0.168378 May 25 17:15:53.545890 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 416/860] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:15:53 2022] DELETE /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/os-volume_attachments/4b072de6-7619-4415-a541-cd7de35e805c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:15:53.555971 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-129ff377-fc26-43be-9c2a-b58455c749a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:53.557056 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-129ff377-fc26-43be-9c2a-b58455c749a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:53.559538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=22 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:53.565648 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-129ff377-fc26-43be-9c2a-b58455c749a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:53.566098 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-129ff377-fc26-43be-9c2a-b58455c749a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:53.566919 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-129ff377-fc26-43be-9c2a-b58455c749a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:53.567367 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-129ff377-fc26-43be-9c2a-b58455c749a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:53.599863 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-129ff377-fc26-43be-9c2a-b58455c749a5 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049294 May 25 17:15:53.600415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 445/861] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:15:53 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:53.985053 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5348ec70-067b-4a9c-9e59-cd8069391042 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:53.985729 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5348ec70-067b-4a9c-9e59-cd8069391042 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:53.992418 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5348ec70-067b-4a9c-9e59-cd8069391042 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:53.992912 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5348ec70-067b-4a9c-9e59-cd8069391042 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:53.993680 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5348ec70-067b-4a9c-9e59-cd8069391042 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:53.994116 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5348ec70-067b-4a9c-9e59-cd8069391042 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:54.024061 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5348ec70-067b-4a9c-9e59-cd8069391042 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments/bd719345-12f9-4ae5-a5db-c61dd723e90e" status: 200 len: 194 microversion: 2.1 time: 0.043855 May 25 17:15:54.024651 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 417/862] 10.222.0.31 () {58 vars in 1412 bytes} [Wed May 25 17:15:53 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments/bd719345-12f9-4ae5-a5db-c61dd723e90e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:54.035226 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1d42376a-61b3-4bf7-8731-db158667e745 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:54.035844 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1d42376a-61b3-4bf7-8731-db158667e745 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:54.042033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1d42376a-61b3-4bf7-8731-db158667e745 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:54.042568 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1d42376a-61b3-4bf7-8731-db158667e745 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:54.043344 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1d42376a-61b3-4bf7-8731-db158667e745 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:54.043881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1d42376a-61b3-4bf7-8731-db158667e745 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:54.126398 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-1d42376a-61b3-4bf7-8731-db158667e745 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lazy-loading 'services' on Instance uuid 3259a826-9d68-40f3-8bb5-7fbf834d3034 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:15:54.196603 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1d42376a-61b3-4bf7-8731-db158667e745 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments/bd719345-12f9-4ae5-a5db-c61dd723e90e" status: 202 len: 0 microversion: 2.1 time: 0.165954 May 25 17:15:54.197253 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 446/863] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:15:54 2022] DELETE /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments/bd719345-12f9-4ae5-a5db-c61dd723e90e => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:15:54.610759 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1ece0b38-ce41-47eb-8565-1115c7b8032e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:54.611680 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1ece0b38-ce41-47eb-8565-1115c7b8032e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:54.618236 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1ece0b38-ce41-47eb-8565-1115c7b8032e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:54.618682 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1ece0b38-ce41-47eb-8565-1115c7b8032e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:54.619436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1ece0b38-ce41-47eb-8565-1115c7b8032e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:54.619866 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1ece0b38-ce41-47eb-8565-1115c7b8032e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:54.652580 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1ece0b38-ce41-47eb-8565-1115c7b8032e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045708 May 25 17:15:54.653194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 418/864] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:15:54 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 17:15:54.713993 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4eb406d0-a17d-4eb3-ba3a-4ebac85330b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:54.714647 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4eb406d0-a17d-4eb3-ba3a-4ebac85330b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:54.721283 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4eb406d0-a17d-4eb3-ba3a-4ebac85330b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:54.721740 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4eb406d0-a17d-4eb3-ba3a-4ebac85330b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:54.722516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4eb406d0-a17d-4eb3-ba3a-4ebac85330b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:54.722960 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4eb406d0-a17d-4eb3-ba3a-4ebac85330b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:54.747963 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4eb406d0-a17d-4eb3-ba3a-4ebac85330b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:15:54.827194 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4eb406d0-a17d-4eb3-ba3a-4ebac85330b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 204 len: 0 microversion: 2.1 time: 0.117996 May 25 17:15:54.828145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 447/865] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:15:54 2022] DELETE /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:15:54.836280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ec0856e7-8533-419b-9f91-ecc90e28308b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:54.837578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ec0856e7-8533-419b-9f91-ecc90e28308b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:54.843605 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec0856e7-8533-419b-9f91-ecc90e28308b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:54.844057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec0856e7-8533-419b-9f91-ecc90e28308b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:54.844892 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec0856e7-8533-419b-9f91-ecc90e28308b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:54.845332 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec0856e7-8533-419b-9f91-ecc90e28308b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:54.981666 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ec0856e7-8533-419b-9f91-ecc90e28308b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:54.989177 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ec0856e7-8533-419b-9f91-ecc90e28308b tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1681 microversion: 2.1 time: 0.157093 May 25 17:15:54.989744 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 419/866] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:54 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:55.360511 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-da43114c-5a82-45bd-872f-fa35955efcb9 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:55.361618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-da43114c-5a82-45bd-872f-fa35955efcb9 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:55.367547 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-da43114c-5a82-45bd-872f-fa35955efcb9 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:55.367993 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-da43114c-5a82-45bd-872f-fa35955efcb9 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:55.368771 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-da43114c-5a82-45bd-872f-fa35955efcb9 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:55.369205 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-da43114c-5a82-45bd-872f-fa35955efcb9 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:55.398733 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-da43114c-5a82-45bd-872f-fa35955efcb9 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042408 May 25 17:15:55.399276 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 448/867] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:15:55 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:56.008423 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2b96d708-2e79-4bf0-b792-f419476b31eb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:56.009012 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2b96d708-2e79-4bf0-b792-f419476b31eb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:56.015712 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b96d708-2e79-4bf0-b792-f419476b31eb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:56.016168 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b96d708-2e79-4bf0-b792-f419476b31eb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:56.016967 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b96d708-2e79-4bf0-b792-f419476b31eb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:56.017407 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b96d708-2e79-4bf0-b792-f419476b31eb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:56.149264 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2b96d708-2e79-4bf0-b792-f419476b31eb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:56.156860 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2b96d708-2e79-4bf0-b792-f419476b31eb tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1681 microversion: 2.1 time: 0.153959 May 25 17:15:56.157428 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 420/868] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:56 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:56.410533 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2b13cffe-31f8-42e2-8a47-0a006eb8d6fc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:56.412231 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2b13cffe-31f8-42e2-8a47-0a006eb8d6fc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:56.418729 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2b13cffe-31f8-42e2-8a47-0a006eb8d6fc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:56.419182 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2b13cffe-31f8-42e2-8a47-0a006eb8d6fc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:56.419965 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2b13cffe-31f8-42e2-8a47-0a006eb8d6fc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:56.420407 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2b13cffe-31f8-42e2-8a47-0a006eb8d6fc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:56.448725 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2b13cffe-31f8-42e2-8a47-0a006eb8d6fc tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042067 May 25 17:15:56.449294 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 449/869] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:15:56 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 17:15:56.557636 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7f368479-4a8c-4d56-ae8a-1369ae9ed3a4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:56.558635 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7f368479-4a8c-4d56-ae8a-1369ae9ed3a4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:56.565125 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7f368479-4a8c-4d56-ae8a-1369ae9ed3a4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:56.565586 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7f368479-4a8c-4d56-ae8a-1369ae9ed3a4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:56.566360 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7f368479-4a8c-4d56-ae8a-1369ae9ed3a4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:56.566805 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7f368479-4a8c-4d56-ae8a-1369ae9ed3a4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:56.596019 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7f368479-4a8c-4d56-ae8a-1369ae9ed3a4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042371 May 25 17:15:56.596592 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 421/870] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:15:56 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 17:15:56.657285 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-28c708d8-9749-4cda-8a35-6965ad169d2b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:56.657714 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-28c708d8-9749-4cda-8a35-6965ad169d2b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:56.665420 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-28c708d8-9749-4cda-8a35-6965ad169d2b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:56.665888 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-28c708d8-9749-4cda-8a35-6965ad169d2b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:56.666645 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-28c708d8-9749-4cda-8a35-6965ad169d2b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:56.667083 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-28c708d8-9749-4cda-8a35-6965ad169d2b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:56.693983 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-28c708d8-9749-4cda-8a35-6965ad169d2b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:15:56.770870 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-28c708d8-9749-4cda-8a35-6965ad169d2b tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 204 len: 0 microversion: 2.1 time: 0.116645 May 25 17:15:56.771451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 450/871] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:15:56 2022] DELETE /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:15:56.779710 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d6cabcc1-536d-4e20-9f35-b0d6528041cd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:56.780319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d6cabcc1-536d-4e20-9f35-b0d6528041cd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:56.786740 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6cabcc1-536d-4e20-9f35-b0d6528041cd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:56.787202 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6cabcc1-536d-4e20-9f35-b0d6528041cd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:56.787986 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6cabcc1-536d-4e20-9f35-b0d6528041cd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:56.788421 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6cabcc1-536d-4e20-9f35-b0d6528041cd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:56.918812 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d6cabcc1-536d-4e20-9f35-b0d6528041cd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:56.927034 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d6cabcc1-536d-4e20-9f35-b0d6528041cd tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1673 microversion: 2.1 time: 0.150531 May 25 17:15:56.927566 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 422/872] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:56 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:57.176041 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3c8ab38f-01b5-4f22-af2b-ca046d13114e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:57.177332 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3c8ab38f-01b5-4f22-af2b-ca046d13114e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:57.183587 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c8ab38f-01b5-4f22-af2b-ca046d13114e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:57.184033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c8ab38f-01b5-4f22-af2b-ca046d13114e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:57.184836 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c8ab38f-01b5-4f22-af2b-ca046d13114e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:57.185535 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c8ab38f-01b5-4f22-af2b-ca046d13114e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:57.338732 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3c8ab38f-01b5-4f22-af2b-ca046d13114e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:57.349431 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3c8ab38f-01b5-4f22-af2b-ca046d13114e tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1613 microversion: 2.1 time: 0.176708 May 25 17:15:57.358998 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 451/873] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:57 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1613 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:57.513868 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-e9bf34f2-5147-43c2-ba9c-3b90e1830153 req-c6139a81-b488-432a-a776-86fe5802005d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22", "name": "network-vif-deleted", "tag": "dedf9efc-5bd6-424a-84ab-5d5e38a62058"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:57.522785 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-e9bf34f2-5147-43c2-ba9c-3b90e1830153 req-c6139a81-b488-432a-a776-86fe5802005d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:57.523318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-e9bf34f2-5147-43c2-ba9c-3b90e1830153 req-c6139a81-b488-432a-a776-86fe5802005d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:57.534631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-e9bf34f2-5147-43c2-ba9c-3b90e1830153 req-c6139a81-b488-432a-a776-86fe5802005d service nova] Creating event network-vif-deleted:dedf9efc-5bd6-424a-84ab-5d5e38a62058 for instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 on hv-cinder-84330 May 25 17:15:57.540512 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-e9bf34f2-5147-43c2-ba9c-3b90e1830153 req-c6139a81-b488-432a-a776-86fe5802005d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030227 May 25 17:15:57.541195 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 423/874] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:15:57.945136 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5dc53d74-08d8-4a45-827e-e92dc3a75e25 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:57.945750 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5dc53d74-08d8-4a45-827e-e92dc3a75e25 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:57.952252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5dc53d74-08d8-4a45-827e-e92dc3a75e25 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:57.952727 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5dc53d74-08d8-4a45-827e-e92dc3a75e25 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:57.953504 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5dc53d74-08d8-4a45-827e-e92dc3a75e25 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:57.953947 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5dc53d74-08d8-4a45-827e-e92dc3a75e25 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:58.090243 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5dc53d74-08d8-4a45-827e-e92dc3a75e25 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:58.101950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5dc53d74-08d8-4a45-827e-e92dc3a75e25 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1673 microversion: 2.1 time: 0.159963 May 25 17:15:58.102257 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 452/875] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:57 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:58.367479 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:58.368868 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:58.375467 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:58.375926 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:58.376715 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:58.377158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:58.419367 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:58.420236 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:58.420236 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lazy-loading 'fault' on Instance uuid c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:15:58.467405 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5eecf3e244058905ea3aba8112320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:58.475063 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-60bcfdc3-d91b-4982-9d31-dec412941986 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 200 len: 1332 microversion: 2.1 time: 0.112573 May 25 17:15:58.475846 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 424/876] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:58 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:59.119980 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-02af63b2-1827-480e-9244-a29dbd55c78c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:59.120973 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-02af63b2-1827-480e-9244-a29dbd55c78c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:59.129060 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-02af63b2-1827-480e-9244-a29dbd55c78c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:59.130196 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-02af63b2-1827-480e-9244-a29dbd55c78c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:59.131147 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-02af63b2-1827-480e-9244-a29dbd55c78c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:59.131855 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-02af63b2-1827-480e-9244-a29dbd55c78c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:59.318643 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-02af63b2-1827-480e-9244-a29dbd55c78c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902f574061e64236ae8d6df08093c8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7691c75f7a3448e38a99489d3df21925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:15:59.326533 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-02af63b2-1827-480e-9244-a29dbd55c78c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 200 len: 1673 microversion: 2.1 time: 0.210867 May 25 17:15:59.327123 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 453/877] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:59 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 1673 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:15:59.492819 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7fe6324e-2143-4dd5-91fd-0151b3d77448 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:59.493366 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7fe6324e-2143-4dd5-91fd-0151b3d77448 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:15:59.499851 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7fe6324e-2143-4dd5-91fd-0151b3d77448 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:59.500286 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7fe6324e-2143-4dd5-91fd-0151b3d77448 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:59.501149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7fe6324e-2143-4dd5-91fd-0151b3d77448 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:59.501582 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7fe6324e-2143-4dd5-91fd-0151b3d77448 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:59.515771 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-7fe6324e-2143-4dd5-91fd-0151b3d77448 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7fe6324e-2143-4dd5-91fd-0151b3d77448 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 HTTP/1.1 May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:15:59.517452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:15:59.519166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22'} May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:15:59.520084 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:15:59.521679 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:15:59.523059 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7fe6324e-2143-4dd5-91fd-0151b3d77448 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:15:59.523059 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7fe6324e-2143-4dd5-91fd-0151b3d77448 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 404 len: 111 microversion: 2.1 time: 0.030635 May 25 17:15:59.523059 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 425/878] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:15:59 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:15:59.527825 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f264ace8-c71c-45bd-ab4e-ef4a07501674 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '.version_select at 0x7f3d4e0d2d30>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:15:59.546694 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f264ace8-c71c-45bd-ab4e-ef4a07501674 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002748408" status: 202 len: 0 microversion: 2.1 time: 0.022588 May 25 17:15:59.547273 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 454/879] 10.222.0.31 () {58 vars in 1220 bytes} [Wed May 25 17:15:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002748408 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:15:59.652154 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-07f69035-4a07-49e3-aca1-cb1b9baba7b9 req-6c46f121-62ee-44c4-b9ae-bfb2dea337e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3259a826-9d68-40f3-8bb5-7fbf834d3034", "name": "network-vif-deleted", "tag": "bb56c734-467a-4a0f-ac64-9ec157c05204"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:15:59.661493 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-07f69035-4a07-49e3-aca1-cb1b9baba7b9 req-6c46f121-62ee-44c4-b9ae-bfb2dea337e0 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:15:59.662321 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-07f69035-4a07-49e3-aca1-cb1b9baba7b9 req-6c46f121-62ee-44c4-b9ae-bfb2dea337e0 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:15:59.694780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-07f69035-4a07-49e3-aca1-cb1b9baba7b9 req-6c46f121-62ee-44c4-b9ae-bfb2dea337e0 service nova] Creating event network-vif-deleted:bb56c734-467a-4a0f-ac64-9ec157c05204 for instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 on hv-cinder-84330 May 25 17:15:59.713594 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-07f69035-4a07-49e3-aca1-cb1b9baba7b9 req-6c46f121-62ee-44c4-b9ae-bfb2dea337e0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064929 May 25 17:15:59.718386 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 426/880] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:16:00.344503 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9dc820e8-d314-46dd-be7b-4f8a7ef8a0c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:00.345142 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-9dc820e8-d314-46dd-be7b-4f8a7ef8a0c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:00.353208 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9dc820e8-d314-46dd-be7b-4f8a7ef8a0c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:00.353662 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9dc820e8-d314-46dd-be7b-4f8a7ef8a0c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:00.354435 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9dc820e8-d314-46dd-be7b-4f8a7ef8a0c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:00.354902 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9dc820e8-d314-46dd-be7b-4f8a7ef8a0c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:00.369199 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-9dc820e8-d314-46dd-be7b-4f8a7ef8a0c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] HTTP exception thrown: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9dc820e8-d314-46dd-be7b-4f8a7ef8a0c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Request method failure captured: May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 HTTP/1.1 May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmK8cP-YJ2I-M6eAL0PTEL4lqAgq3m8brrJjvLDl_zivtWKyCbiLzYig9f-8JUqBPjUQIyQDyez1qaSYf09VJ_ieMgWjJdOZQQNkAjyh-VGHis4RtsJjR3_preG7JFpusOQmKbpxyaK2Be0BU7XL5ztyyS36-9NFfPzad9VPzSl4rSQ May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:00.370862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_7691c75f7a3448e38a99489d3df21925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}] May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeTestJSON-328720228-project May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 902f574061e64236ae8d6df08093c8e2 May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeTestJSON-328720228-project May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:00.372470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '3259a826-9d68-40f3-8bb5-7fbf834d3034'} May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:00.373406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:00.374831 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:00.376116 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9dc820e8-d314-46dd-be7b-4f8a7ef8a0c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Returning 404 to user: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:00.376116 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9dc820e8-d314-46dd-be7b-4f8a7ef8a0c4 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 404 len: 111 microversion: 2.1 time: 0.031986 May 25 17:16:00.376290 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 455/881] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:00 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:00.382155 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3b8282bb-2ad4-4f8d-9bc3-64a1d37663ec tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '.version_select at 0x7f3d4eb5df70>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:00.400859 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3b8282bb-2ad4-4f8d-9bc3-64a1d37663ec tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451147041" status: 202 len: 0 microversion: 2.1 time: 0.023310 May 25 17:16:00.401565 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 427/882] 10.222.0.31 () {58 vars in 1220 bytes} [Wed May 25 17:16:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451147041 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:16:01.374504 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-143efc65-39a2-427a-9d2d-1b4443fdd4c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:01.375011 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-143efc65-39a2-427a-9d2d-1b4443fdd4c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:01.382327 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-143efc65-39a2-427a-9d2d-1b4443fdd4c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:01.382753 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-143efc65-39a2-427a-9d2d-1b4443fdd4c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:01.383518 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-143efc65-39a2-427a-9d2d-1b4443fdd4c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:01.383958 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-143efc65-39a2-427a-9d2d-1b4443fdd4c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:01.397491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-143efc65-39a2-427a-9d2d-1b4443fdd4c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-143efc65-39a2-427a-9d2d-1b4443fdd4c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: DELETE /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 HTTP/1.1 May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:01.399023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:16:01.400580 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': 'c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22'} May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:01.401554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:16:01.402949 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:01.404462 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-143efc65-39a2-427a-9d2d-1b4443fdd4c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:01.404462 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-143efc65-39a2-427a-9d2d-1b4443fdd4c0 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 404 len: 111 microversion: 2.1 time: 0.029788 May 25 17:16:01.404462 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 456/883] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:16:01 2022] DELETE /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:01.409301 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bf807adb-3cb9-4c43-a2fa-0416844ec180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:01.410034 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bf807adb-3cb9-4c43-a2fa-0416844ec180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:01.416973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bf807adb-3cb9-4c43-a2fa-0416844ec180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:01.417435 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bf807adb-3cb9-4c43-a2fa-0416844ec180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:01.418204 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bf807adb-3cb9-4c43-a2fa-0416844ec180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:01.418645 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bf807adb-3cb9-4c43-a2fa-0416844ec180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:01.432523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-bf807adb-3cb9-4c43-a2fa-0416844ec180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bf807adb-3cb9-4c43-a2fa-0416844ec180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 HTTP/1.1 May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:01.434165 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:16:01.435973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22'} May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:01.436992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. May 25 17:16:01.438464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:01.439758 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bf807adb-3cb9-4c43-a2fa-0416844ec180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:01.439758 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bf807adb-3cb9-4c43-a2fa-0416844ec180 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22" status: 404 len: 111 microversion: 2.1 time: 0.030666 May 25 17:16:01.439758 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 428/884] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:01 2022] GET /compute/v2.1/servers/c63cfd6f-acf0-4fe9-89ab-3b701ccb2f22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:16:02.572110 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f6fbcfec-fbcf-4c82-8d9b-17ef7c8df8fa tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:02.572658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f6fbcfec-fbcf-4c82-8d9b-17ef7c8df8fa tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:02.578910 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f6fbcfec-fbcf-4c82-8d9b-17ef7c8df8fa tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:02.579363 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f6fbcfec-fbcf-4c82-8d9b-17ef7c8df8fa tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:02.580124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f6fbcfec-fbcf-4c82-8d9b-17ef7c8df8fa tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:02.580559 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f6fbcfec-fbcf-4c82-8d9b-17ef7c8df8fa tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:02.594338 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-f6fbcfec-fbcf-4c82-8d9b-17ef7c8df8fa tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f6fbcfec-fbcf-4c82-8d9b-17ef7c8df8fa tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: DELETE /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef HTTP/1.1 May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:02.595874 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:16:02.597463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': 'd856fd3d-ee9c-45ec-b4a1-46789378a5ef'} May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:02.599220 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:16:02.600665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:02.602480 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f6fbcfec-fbcf-4c82-8d9b-17ef7c8df8fa tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:02.602480 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f6fbcfec-fbcf-4c82-8d9b-17ef7c8df8fa tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 404 len: 111 microversion: 2.1 time: 0.029374 May 25 17:16:02.602480 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 457/885] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:16:02 2022] DELETE /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:02.606617 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3e8d411e-89f5-4922-bbff-dff580829f19 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:02.607236 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3e8d411e-89f5-4922-bbff-dff580829f19 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: d856fd3d-ee9c-45ec-b4a1-46789378a5ef] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:02.613857 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3e8d411e-89f5-4922-bbff-dff580829f19 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:02.614317 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3e8d411e-89f5-4922-bbff-dff580829f19 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:02.615078 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3e8d411e-89f5-4922-bbff-dff580829f19 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:02.615518 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3e8d411e-89f5-4922-bbff-dff580829f19 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:02.629009 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-3e8d411e-89f5-4922-bbff-dff580829f19 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3e8d411e-89f5-4922-bbff-dff580829f19 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef HTTP/1.1 May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:02.630640 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:16:02.632161 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'd856fd3d-ee9c-45ec-b4a1-46789378a5ef'} May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:02.633137 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. May 25 17:16:02.634412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:02.635657 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3e8d411e-89f5-4922-bbff-dff580829f19 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance d856fd3d-ee9c-45ec-b4a1-46789378a5ef could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:02.635657 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3e8d411e-89f5-4922-bbff-dff580829f19 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef" status: 404 len: 111 microversion: 2.1 time: 0.029555 May 25 17:16:02.635657 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 429/886] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:02 2022] GET /compute/v2.1/servers/d856fd3d-ee9c-45ec-b4a1-46789378a5ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:02.640658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ddfce4bf-e7b5-49a7-b21b-144527a47365 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:02.641207 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ddfce4bf-e7b5-49a7-b21b-144527a47365 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:02.648020 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ddfce4bf-e7b5-49a7-b21b-144527a47365 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:02.648464 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ddfce4bf-e7b5-49a7-b21b-144527a47365 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:02.649265 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ddfce4bf-e7b5-49a7-b21b-144527a47365 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:02.649697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ddfce4bf-e7b5-49a7-b21b-144527a47365 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:02.652282 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:02.665382 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-ddfce4bf-e7b5-49a7-b21b-144527a47365 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ddfce4bf-e7b5-49a7-b21b-144527a47365 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: DELETE /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b HTTP/1.1 May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:02.667051 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:16:02.668595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '145de36f-e49b-4444-85c5-4a207d31619b'} May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:02.670606 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:16:02.672156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:02.673686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ddfce4bf-e7b5-49a7-b21b-144527a47365 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:02.673686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ddfce4bf-e7b5-49a7-b21b-144527a47365 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 404 len: 111 microversion: 2.1 time: 0.031619 May 25 17:16:02.673686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 458/887] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:16:02 2022] DELETE /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:16:02.679387 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-33f7bd54-bb33-40f2-ab95-e385aa8e24ca tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:02.680000 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-33f7bd54-bb33-40f2-ab95-e385aa8e24ca tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 145de36f-e49b-4444-85c5-4a207d31619b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:02.686654 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-33f7bd54-bb33-40f2-ab95-e385aa8e24ca tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:02.687098 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-33f7bd54-bb33-40f2-ab95-e385aa8e24ca tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:02.687889 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-33f7bd54-bb33-40f2-ab95-e385aa8e24ca tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:02.688324 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-33f7bd54-bb33-40f2-ab95-e385aa8e24ca tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:02.702827 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-33f7bd54-bb33-40f2-ab95-e385aa8e24ca tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-33f7bd54-bb33-40f2-ab95-e385aa8e24ca tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b HTTP/1.1 May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:02.704388 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:16:02.705975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '145de36f-e49b-4444-85c5-4a207d31619b'} May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:02.706780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. May 25 17:16:02.708553 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:02.709733 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-33f7bd54-bb33-40f2-ab95-e385aa8e24ca tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance 145de36f-e49b-4444-85c5-4a207d31619b could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:02.709733 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-33f7bd54-bb33-40f2-ab95-e385aa8e24ca tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b" status: 404 len: 111 microversion: 2.1 time: 0.031167 May 25 17:16:02.709733 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 430/888] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:02 2022] GET /compute/v2.1/servers/145de36f-e49b-4444-85c5-4a207d31619b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:16:03.278953 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0e14ee00-a0ca-4a7c-b668-bc966be83564 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:03.279454 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0e14ee00-a0ca-4a7c-b668-bc966be83564 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:03.286018 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e14ee00-a0ca-4a7c-b668-bc966be83564 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:03.286498 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e14ee00-a0ca-4a7c-b668-bc966be83564 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:03.287264 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e14ee00-a0ca-4a7c-b668-bc966be83564 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:03.287702 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e14ee00-a0ca-4a7c-b668-bc966be83564 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:03.300750 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-0e14ee00-a0ca-4a7c-b668-bc966be83564 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] HTTP exception thrown: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0e14ee00-a0ca-4a7c-b668-bc966be83564 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Request method failure captured: May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: DELETE /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 HTTP/1.1 May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmK8cP-YJ2I-M6eAL0PTEL4lqAgq3m8brrJjvLDl_zivtWKyCbiLzYig9f-8JUqBPjUQIyQDyez1qaSYf09VJ_ieMgWjJdOZQQNkAjyh-VGHis4RtsJjR3_preG7JFpusOQmKbpxyaK2Be0BU7XL5ztyyS36-9NFfPzad9VPzSl4rSQ May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:03.302903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_7691c75f7a3448e38a99489d3df21925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}] May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeTestJSON-328720228-project May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 902f574061e64236ae8d6df08093c8e2 May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeTestJSON-328720228-project May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:03.304516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '3259a826-9d68-40f3-8bb5-7fbf834d3034'} May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:03.305440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:03.306834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:03.308125 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0e14ee00-a0ca-4a7c-b668-bc966be83564 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Returning 404 to user: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:03.308125 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0e14ee00-a0ca-4a7c-b668-bc966be83564 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 404 len: 111 microversion: 2.1 time: 0.029399 May 25 17:16:03.308125 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 459/889] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:16:03 2022] DELETE /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:03.313060 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a9eecef3-c82e-4932-91a7-3ac7eb7f887d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:03.313664 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a9eecef3-c82e-4932-91a7-3ac7eb7f887d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 3259a826-9d68-40f3-8bb5-7fbf834d3034] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:03.320399 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a9eecef3-c82e-4932-91a7-3ac7eb7f887d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:03.320875 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a9eecef3-c82e-4932-91a7-3ac7eb7f887d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:03.321628 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a9eecef3-c82e-4932-91a7-3ac7eb7f887d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:03.322062 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a9eecef3-c82e-4932-91a7-3ac7eb7f887d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:03.335483 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-a9eecef3-c82e-4932-91a7-3ac7eb7f887d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] HTTP exception thrown: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a9eecef3-c82e-4932-91a7-3ac7eb7f887d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Request method failure captured: May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 HTTP/1.1 May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmK8cP-YJ2I-M6eAL0PTEL4lqAgq3m8brrJjvLDl_zivtWKyCbiLzYig9f-8JUqBPjUQIyQDyez1qaSYf09VJ_ieMgWjJdOZQQNkAjyh-VGHis4RtsJjR3_preG7JFpusOQmKbpxyaK2Be0BU7XL5ztyyS36-9NFfPzad9VPzSl4rSQ May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:03.337047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_7691c75f7a3448e38a99489d3df21925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}] May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeTestJSON-328720228-project May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 902f574061e64236ae8d6df08093c8e2 May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeTestJSON-328720228-project May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:03.338653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '3259a826-9d68-40f3-8bb5-7fbf834d3034'} May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:03.339436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. May 25 17:16:03.340585 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:03.341692 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a9eecef3-c82e-4932-91a7-3ac7eb7f887d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Returning 404 to user: Instance 3259a826-9d68-40f3-8bb5-7fbf834d3034 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:03.341692 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a9eecef3-c82e-4932-91a7-3ac7eb7f887d tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034" status: 404 len: 111 microversion: 2.1 time: 0.029638 May 25 17:16:03.341692 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 431/890] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:03 2022] GET /compute/v2.1/servers/3259a826-9d68-40f3-8bb5-7fbf834d3034 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:03.839878 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ae8d45c2-8a32-46c7-b4b1-ab17f1090995 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:03.840380 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ae8d45c2-8a32-46c7-b4b1-ab17f1090995 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:03.846867 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ae8d45c2-8a32-46c7-b4b1-ab17f1090995 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:03.847318 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ae8d45c2-8a32-46c7-b4b1-ab17f1090995 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:03.848907 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ae8d45c2-8a32-46c7-b4b1-ab17f1090995 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:03.849352 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ae8d45c2-8a32-46c7-b4b1-ab17f1090995 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:03.862396 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-ae8d45c2-8a32-46c7-b4b1-ab17f1090995 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ae8d45c2-8a32-46c7-b4b1-ab17f1090995 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: DELETE /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 HTTP/1.1 May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:03.863858 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:16:03.865351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '4176ef9b-9601-4e3d-bc52-51854be03fd7'} May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:03.866210 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:16:03.867660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:03.869145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ae8d45c2-8a32-46c7-b4b1-ab17f1090995 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:03.869145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ae8d45c2-8a32-46c7-b4b1-ab17f1090995 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 404 len: 111 microversion: 2.1 time: 0.029429 May 25 17:16:03.869145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 460/891] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:16:03 2022] DELETE /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:03.873811 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-dfe25fdb-0b8f-4bf1-9158-82692221d9b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:03.874430 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-dfe25fdb-0b8f-4bf1-9158-82692221d9b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] [instance: 4176ef9b-9601-4e3d-bc52-51854be03fd7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:03.881210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfe25fdb-0b8f-4bf1-9158-82692221d9b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:03.881671 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfe25fdb-0b8f-4bf1-9158-82692221d9b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:03.882448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfe25fdb-0b8f-4bf1-9158-82692221d9b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:03.882891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfe25fdb-0b8f-4bf1-9158-82692221d9b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:03.896882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-dfe25fdb-0b8f-4bf1-9158-82692221d9b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] HTTP exception thrown: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-dfe25fdb-0b8f-4bf1-9158-82692221d9b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Request method failure captured: May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 HTTP/1.1 May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLM6J2bzyLW9KFeGDjwe6QdAj83EfR--HDiERLkcry45bi6xLoXrkE_ztDHn3sIAoiRWRrVWZdvWZqdn_-Pbo-53MgKdH9Ixwn5Q1kbP3EhWwPmIWIXBOWPV8nxLewMoLLIDU8Cm_LAJn9LIONR0tzFDnlny435GfOnjeTGdpib3yU May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:03.898429 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/6ad0c3cc9eaf41c09d6b967a2fa49900"}]}] May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 6ad0c3cc9eaf41c09d6b967a2fa49900 May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284703226 May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 3fb5eecf3e244058905ea3aba8112320 May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-284703226-project May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:16:03.900035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '4176ef9b-9601-4e3d-bc52-51854be03fd7'} May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:03.900935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. May 25 17:16:03.902172 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:03.903232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-dfe25fdb-0b8f-4bf1-9158-82692221d9b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] Returning 404 to user: Instance 4176ef9b-9601-4e3d-bc52-51854be03fd7 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:03.903232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-dfe25fdb-0b8f-4bf1-9158-82692221d9b6 tempest-AttachVolumeNegativeTest-284703226 tempest-AttachVolumeNegativeTest-284703226-project] 10.222.0.31 "GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7" status: 404 len: 111 microversion: 2.1 time: 0.029902 May 25 17:16:03.903232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 432/892] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:03 2022] GET /compute/v2.1/servers/4176ef9b-9601-4e3d-bc52-51854be03fd7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:04.470523 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ecd5b045-a826-47dc-965b-128aa4e9ef29 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:04.471033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-ecd5b045-a826-47dc-965b-128aa4e9ef29 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:04.479447 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ecd5b045-a826-47dc-965b-128aa4e9ef29 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:04.479902 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ecd5b045-a826-47dc-965b-128aa4e9ef29 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:04.482572 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ecd5b045-a826-47dc-965b-128aa4e9ef29 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:04.483030 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-ecd5b045-a826-47dc-965b-128aa4e9ef29 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:04.498259 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-ecd5b045-a826-47dc-965b-128aa4e9ef29 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] HTTP exception thrown: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ecd5b045-a826-47dc-965b-128aa4e9ef29 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Request method failure captured: May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: DELETE /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 HTTP/1.1 May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmK8cP-YJ2I-M6eAL0PTEL4lqAgq3m8brrJjvLDl_zivtWKyCbiLzYig9f-8JUqBPjUQIyQDyez1qaSYf09VJ_ieMgWjJdOZQQNkAjyh-VGHis4RtsJjR3_preG7JFpusOQmKbpxyaK2Be0BU7XL5ztyyS36-9NFfPzad9VPzSl4rSQ May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:04.499856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_7691c75f7a3448e38a99489d3df21925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}] May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeTestJSON-328720228-project May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 902f574061e64236ae8d6df08093c8e2 May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeTestJSON-328720228-project May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:16:04.501463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '5ecb9b07-e50d-4926-b95d-af40c6093d83'} May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:04.502347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:16:04.503788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:04.505471 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-ecd5b045-a826-47dc-965b-128aa4e9ef29 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Returning 404 to user: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:04.505471 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-ecd5b045-a826-47dc-965b-128aa4e9ef29 tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 404 len: 111 microversion: 2.1 time: 0.034702 May 25 17:16:04.505471 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 461/893] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:16:04 2022] DELETE /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:04.510404 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ee2d55ba-bc4a-4f70-88e5-2bcc1f41ba7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:04.511039 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ee2d55ba-bc4a-4f70-88e5-2bcc1f41ba7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] [instance: 5ecb9b07-e50d-4926-b95d-af40c6093d83] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:04.516949 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ee2d55ba-bc4a-4f70-88e5-2bcc1f41ba7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:04.517397 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ee2d55ba-bc4a-4f70-88e5-2bcc1f41ba7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:04.518154 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ee2d55ba-bc4a-4f70-88e5-2bcc1f41ba7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:04.518586 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ee2d55ba-bc4a-4f70-88e5-2bcc1f41ba7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:04.532124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-ee2d55ba-bc4a-4f70-88e5-2bcc1f41ba7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] HTTP exception thrown: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ee2d55ba-bc4a-4f70-88e5-2bcc1f41ba7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Request method failure captured: May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 HTTP/1.1 May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmK8cP-YJ2I-M6eAL0PTEL4lqAgq3m8brrJjvLDl_zivtWKyCbiLzYig9f-8JUqBPjUQIyQDyez1qaSYf09VJ_ieMgWjJdOZQQNkAjyh-VGHis4RtsJjR3_preG7JFpusOQmKbpxyaK2Be0BU7XL5ztyyS36-9NFfPzad9VPzSl4rSQ May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:04.533713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_7691c75f7a3448e38a99489d3df21925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/7691c75f7a3448e38a99489d3df21925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/7691c75f7a3448e38a99489d3df21925"}]}] May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 7691c75f7a3448e38a99489d3df21925 May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-328720228 May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeTestJSON-328720228-project May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 902f574061e64236ae8d6df08093c8e2 May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeTestJSON-328720228-project May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:16:04.535855 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '5ecb9b07-e50d-4926-b95d-af40c6093d83'} May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:04.537424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. May 25 17:16:04.538849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:04.541174 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ee2d55ba-bc4a-4f70-88e5-2bcc1f41ba7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] Returning 404 to user: Instance 5ecb9b07-e50d-4926-b95d-af40c6093d83 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:04.541174 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ee2d55ba-bc4a-4f70-88e5-2bcc1f41ba7c tempest-AttachVolumeTestJSON-328720228 tempest-AttachVolumeTestJSON-328720228-project] 10.222.0.31 "GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83" status: 404 len: 111 microversion: 2.1 time: 0.028553 May 25 17:16:04.541174 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 433/894] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:04 2022] GET /compute/v2.1/servers/5ecb9b07-e50d-4926-b95d-af40c6093d83 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:09.632701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3bb5cd13-82df-4cf6-9058-400594c4abb5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:09.633988 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3bb5cd13-82df-4cf6-9058-400594c4abb5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:09.641437 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3bb5cd13-82df-4cf6-9058-400594c4abb5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:09.641885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3bb5cd13-82df-4cf6-9058-400594c4abb5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:09.644059 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3bb5cd13-82df-4cf6-9058-400594c4abb5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:09.646411 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3bb5cd13-82df-4cf6-9058-400594c4abb5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:09.689116 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3bb5cd13-82df-4cf6-9058-400594c4abb5 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066520 May 25 17:16:09.689859 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 462/895] 10.222.0.31 () {60 vars in 1342 bytes} [Wed May 25 17:16:09 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:09.766841 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cfac3856-f0c5-4ef2-be48-e71ed8fc61bd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:09.767555 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cfac3856-f0c5-4ef2-be48-e71ed8fc61bd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:09.770932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:09.776410 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cfac3856-f0c5-4ef2-be48-e71ed8fc61bd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:09.777109 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cfac3856-f0c5-4ef2-be48-e71ed8fc61bd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:09.778082 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cfac3856-f0c5-4ef2-be48-e71ed8fc61bd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:09.778510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cfac3856-f0c5-4ef2-be48-e71ed8fc61bd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:09.815676 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cfac3856-f0c5-4ef2-be48-e71ed8fc61bd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:16:09.921662 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cfac3856-f0c5-4ef2-be48-e71ed8fc61bd tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "DELETE /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 204 len: 0 microversion: 2.20 time: 0.158047 May 25 17:16:09.922230 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 434/896] 10.222.0.31 () {60 vars in 1279 bytes} [Wed May 25 17:16:09 2022] DELETE /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 17:16:09.931292 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d1be47b4-d64b-4afb-8655-1e2ae5809fea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:09.932003 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d1be47b4-d64b-4afb-8655-1e2ae5809fea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:09.938974 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1be47b4-d64b-4afb-8655-1e2ae5809fea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:09.939436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1be47b4-d64b-4afb-8655-1e2ae5809fea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:09.940220 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1be47b4-d64b-4afb-8655-1e2ae5809fea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:09.940663 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1be47b4-d64b-4afb-8655-1e2ae5809fea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:10.099149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d1be47b4-d64b-4afb-8655-1e2ae5809fea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:10.101286 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e7354393-42ee-4826-b425-ce5b4c618cbd tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Action: 'create', calling method: .version_select at 0x7f3d4e138c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-551998460", "metadata": {"Type": "work"}}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:16:10.108760 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d1be47b4-d64b-4afb-8655-1e2ae5809fea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:10.110185 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d1be47b4-d64b-4afb-8655-1e2ae5809fea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:10.111287 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d1be47b4-d64b-4afb-8655-1e2ae5809fea tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.184395 May 25 17:16:10.111847 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 435/897] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:16:09 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e7354393-42ee-4826-b425-ce5b4c618cbd tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Request method failure captured: May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 121 May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmRZOXtBl9pFgUS_xpeWZHIVTiKcEbXhyoAjodw9DO04fR07l7T1f1XpS_tZn3-xuVRxUQsLR9M5RlPcMKJotTGWfqP5YskMeZo3EGKCUcScs28QGbIqPS5_WqHBMetPIeOCaI1jv0DAXDPuHl4g0NE4mKW9G4hf9ViSgbPG5S1pyP8 May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:10.112505 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}] May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: dd3acbfc053f4823ae12da18581e45cb May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-551998460", "metadata": {"Type": "work"}}} May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: May 25 17:16:10.113881 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-551998460', 'metadata': {'Type': 'work'}}}} May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise error May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi '#$%' May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:10.114696 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 17:16:10.116022 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 17:16:10.117302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 17:16:10.117302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.117302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e7354393-42ee-4826-b425-ce5b4c618cbd tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:10.117302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e7354393-42ee-4826-b425-ce5b4c618cbd tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.309329 May 25 17:16:10.117302 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 463/898] 10.222.0.31 () {60 vars in 1155 bytes} [Wed May 25 17:16:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 311 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 25 17:16:10.130956 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-98a80883-5a23-4cb5-b298-8ac396692736 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Action: 'create', calling method: .version_select at 0x7f3d4ebccee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1153307262", "metadata": {"Type": "work"}}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-98a80883-5a23-4cb5-b298-8ac396692736 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Request method failure captured: May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 120 May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmRZOXtBl9pFgUS_xpeWZHIVTiKcEbXhyoAjodw9DO04fR07l7T1f1XpS_tZn3-xuVRxUQsLR9M5RlPcMKJotTGWfqP5YskMeZo3EGKCUcScs28QGbIqPS5_WqHBMetPIeOCaI1jv0DAXDPuHl4g0NE4mKW9G4hf9ViSgbPG5S1pyP8 May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:10.134412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}] May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: dd3acbfc053f4823ae12da18581e45cb May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1153307262", "metadata": {"Type": "work"}}} May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: May 25 17:16:10.136057 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1153307262', 'metadata': {'Type': 'work'}}}} May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise error May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi '0' May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:10.136991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 17:16:10.138609 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 17:16:10.139947 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 17:16:10.139947 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.139947 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-98a80883-5a23-4cb5-b298-8ac396692736 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:10.139947 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-98a80883-5a23-4cb5-b298-8ac396692736 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008797 May 25 17:16:10.139947 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 436/899] 10.222.0.31 () {60 vars in 1155 bytes} [Wed May 25 17:16:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 17:16:10.147143 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d1e1cade-63c4-4bf9-9de6-9b061f90c1ed tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Action: 'create', calling method: .version_select at 0x7f3d4e478820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-270013610", "metadata": {"Type": "work"}}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d1e1cade-63c4-4bf9-9de6-9b061f90c1ed tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Request method failure captured: May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 118 May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmRZOXtBl9pFgUS_xpeWZHIVTiKcEbXhyoAjodw9DO04fR07l7T1f1XpS_tZn3-xuVRxUQsLR9M5RlPcMKJotTGWfqP5YskMeZo3EGKCUcScs28QGbIqPS5_WqHBMetPIeOCaI1jv0DAXDPuHl4g0NE4mKW9G4hf9ViSgbPG5S1pyP8 May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:10.149619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}] May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: dd3acbfc053f4823ae12da18581e45cb May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-270013610", "metadata": {"Type": "work"}}} May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: May 25 17:16:10.151228 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-270013610', 'metadata': {'Type': 'work'}}}} May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise error May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi '' May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:10.153316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 17:16:10.154741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 17:16:10.156450 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 17:16:10.156450 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.156450 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d1e1cade-63c4-4bf9-9de6-9b061f90c1ed tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:10.156450 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d1e1cade-63c4-4bf9-9de6-9b061f90c1ed tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008750 May 25 17:16:10.156450 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 464/900] 10.222.0.31 () {60 vars in 1155 bytes} [Wed May 25 17:16:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 25 17:16:10.162144 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-edfc55d5-5695-41a2-9b4c-c3f04fb9bac8 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Calling method '.version_select at 0x7f3d4e8ca5e0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:10.190507 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-edfc55d5-5695-41a2-9b4c-c3f04fb9bac8 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] HTTP exception thrown: Volume tempest-invalid-258644346 could not be found. May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-edfc55d5-5695-41a2-9b4c-c3f04fb9bac8 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Request method failure captured: May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-258644346 HTTP/1.1 May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmRZOXtBl9pFgUS_xpeWZHIVTiKcEbXhyoAjodw9DO04fR07l7T1f1XpS_tZn3-xuVRxUQsLR9M5RlPcMKJotTGWfqP5YskMeZo3EGKCUcScs28QGbIqPS5_WqHBMetPIeOCaI1jv0DAXDPuHl4g0NE4mKW9G4hf9ViSgbPG5S1pyP8 May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:10.195932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}] May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: dd3acbfc053f4823ae12da18581e45cb May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Volume tempest-invalid-258644346 could not be found. May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'tempest-invalid-258644346'} May 25 17:16:10.197521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-258644346 could not be found. (HTTP 404) (Request-ID: req-1af812da-bb0b-4a2d-82a1-2c8efba7a88c) May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.198757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 17:16:10.200149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-258644346 could not be found. May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:10.201631 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-258644346 could not be found. May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-258644346 could not be found. May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-edfc55d5-5695-41a2-9b4c-c3f04fb9bac8 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Returning 404 to user: Volume tempest-invalid-258644346 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-edfc55d5-5695-41a2-9b4c-c3f04fb9bac8 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/tempest-invalid-258644346" status: 404 len: 98 microversion: 2.1 time: 0.039844 May 25 17:16:10.203162 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 437/901] 10.222.0.31 () {58 vars in 1214 bytes} [Wed May 25 17:16:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-258644346 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 25 17:16:10.210910 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-70a7d310-afd2-4a8e-bc5b-a65d429399fc tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006550 May 25 17:16:10.211408 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 465/902] 10.222.0.31 () {58 vars in 1139 bytes} [Wed May 25 17:16:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 17:16:10.220251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f7c6b48e-c08a-4a42-98c1-99a68b789d07 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003900 May 25 17:16:10.220772 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 438/903] 10.222.0.31 () {58 vars in 1136 bytes} [Wed May 25 17:16:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 17:16:10.229500 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-072432ac-14be-4e26-b9a0-b0f9f10c4cff tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Calling method '.version_select at 0x7f3d4e138d30>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:10.259145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-072432ac-14be-4e26-b9a0-b0f9f10c4cff tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] HTTP exception thrown: Volume 81380198-0a3c-4f8a-beda-b3bed8437105 could not be found. May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-072432ac-14be-4e26-b9a0-b0f9f10c4cff tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Request method failure captured: May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: DELETE /compute/v2.1/os-volumes/81380198-0a3c-4f8a-beda-b3bed8437105 HTTP/1.1 May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmRZOXtBl9pFgUS_xpeWZHIVTiKcEbXhyoAjodw9DO04fR07l7T1f1XpS_tZn3-xuVRxUQsLR9M5RlPcMKJotTGWfqP5YskMeZo3EGKCUcScs28QGbIqPS5_WqHBMetPIeOCaI1jv0DAXDPuHl4g0NE4mKW9G4hf9ViSgbPG5S1pyP8 May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:10.261577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}] May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: dd3acbfc053f4823ae12da18581e45cb May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Volume 81380198-0a3c-4f8a-beda-b3bed8437105 could not be found. May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '81380198-0a3c-4f8a-beda-b3bed8437105'} May 25 17:16:10.263149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81380198-0a3c-4f8a-beda-b3bed8437105 could not be found. (HTTP 404) (Request-ID: req-8166c6bf-d371-4b17-9643-5c6de926166d) May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.264101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 17:16:10.265515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81380198-0a3c-4f8a-beda-b3bed8437105 could not be found. May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 17:16:10.266785 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81380198-0a3c-4f8a-beda-b3bed8437105 could not be found. May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81380198-0a3c-4f8a-beda-b3bed8437105 could not be found. May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-072432ac-14be-4e26-b9a0-b0f9f10c4cff tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Returning 404 to user: Volume 81380198-0a3c-4f8a-beda-b3bed8437105 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-072432ac-14be-4e26-b9a0-b0f9f10c4cff tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/81380198-0a3c-4f8a-beda-b3bed8437105" status: 404 len: 109 microversion: 2.1 time: 0.037275 May 25 17:16:10.268100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 466/904] 10.222.0.31 () {58 vars in 1247 bytes} [Wed May 25 17:16:10 2022] DELETE /compute/v2.1/os-volumes/81380198-0a3c-4f8a-beda-b3bed8437105 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:16:10.274572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-514f2914-5b76-4cc1-a246-4526ae008842 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Calling method '.version_select at 0x7f3d4e8ca430>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:10.313327 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-514f2914-5b76-4cc1-a246-4526ae008842 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] HTTP exception thrown: Volume e977d556-2130-4ab0-b80c-1ab2847304d0 could not be found. May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-514f2914-5b76-4cc1-a246-4526ae008842 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Request method failure captured: May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/os-volumes/e977d556-2130-4ab0-b80c-1ab2847304d0 HTTP/1.1 May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmRZOXtBl9pFgUS_xpeWZHIVTiKcEbXhyoAjodw9DO04fR07l7T1f1XpS_tZn3-xuVRxUQsLR9M5RlPcMKJotTGWfqP5YskMeZo3EGKCUcScs28QGbIqPS5_WqHBMetPIeOCaI1jv0DAXDPuHl4g0NE4mKW9G4hf9ViSgbPG5S1pyP8 May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:10.315393 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/ac560715c9ed42af930faf40fe5160ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/ac560715c9ed42af930faf40fe5160ae"}]}] May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: ac560715c9ed42af930faf40fe5160ae May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesNegativeTest-1735673178 May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: dd3acbfc053f4823ae12da18581e45cb May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesNegativeTest-1735673178-project May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Volume e977d556-2130-4ab0-b80c-1ab2847304d0 could not be found. May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'e977d556-2130-4ab0-b80c-1ab2847304d0'} May 25 17:16:10.317523 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e977d556-2130-4ab0-b80c-1ab2847304d0 could not be found. (HTTP 404) (Request-ID: req-7d8ff69e-f333-4d3f-9ccd-3bc7158dc040) May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.318448 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 17:16:10.319881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e977d556-2130-4ab0-b80c-1ab2847304d0 could not be found. May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 17:16:10.322254 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e977d556-2130-4ab0-b80c-1ab2847304d0 could not be found. May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e977d556-2130-4ab0-b80c-1ab2847304d0 could not be found. May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-514f2914-5b76-4cc1-a246-4526ae008842 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] Returning 404 to user: Volume e977d556-2130-4ab0-b80c-1ab2847304d0 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-514f2914-5b76-4cc1-a246-4526ae008842 tempest-VolumesNegativeTest-1735673178 tempest-VolumesNegativeTest-1735673178-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e977d556-2130-4ab0-b80c-1ab2847304d0" status: 404 len: 109 microversion: 2.1 time: 0.046665 May 25 17:16:10.323777 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 439/905] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:16:10 2022] GET /compute/v2.1/os-volumes/e977d556-2130-4ab0-b80c-1ab2847304d0 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:11.134943 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8224669f-d621-4f0c-8ce5-76fc3e01597c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:11.135712 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8224669f-d621-4f0c-8ce5-76fc3e01597c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:11.144465 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8224669f-d621-4f0c-8ce5-76fc3e01597c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:11.145196 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8224669f-d621-4f0c-8ce5-76fc3e01597c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:11.145984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8224669f-d621-4f0c-8ce5-76fc3e01597c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:11.146538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8224669f-d621-4f0c-8ce5-76fc3e01597c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:11.322711 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8224669f-d621-4f0c-8ce5-76fc3e01597c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:11.331318 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8224669f-d621-4f0c-8ce5-76fc3e01597c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:11.333383 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8224669f-d621-4f0c-8ce5-76fc3e01597c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:11.334950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8224669f-d621-4f0c-8ce5-76fc3e01597c tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1724 microversion: 2.20 time: 0.204442 May 25 17:16:11.335821 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 467/906] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:16:11 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:16:12.215834 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-8d599eaf-95bd-49d1-9c42-8e90b658f0c9 req-c070f320-9a1d-4a34-be10-fd78dd51e579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a32d7a-f536-4bc3-8048-cfcb457b2881", "name": "network-vif-deleted", "tag": "fc8011bd-f7ca-4b39-81ab-c9bfafbcd234"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:16:12.227053 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-8d599eaf-95bd-49d1-9c42-8e90b658f0c9 req-c070f320-9a1d-4a34-be10-fd78dd51e579 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:12.227546 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-8d599eaf-95bd-49d1-9c42-8e90b658f0c9 req-c070f320-9a1d-4a34-be10-fd78dd51e579 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:12.246032 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-8d599eaf-95bd-49d1-9c42-8e90b658f0c9 req-c070f320-9a1d-4a34-be10-fd78dd51e579 service nova] Creating event network-vif-deleted:fc8011bd-f7ca-4b39-81ab-c9bfafbcd234 for instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 on hv-cinder-84330 May 25 17:16:12.252920 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-8d599eaf-95bd-49d1-9c42-8e90b658f0c9 req-c070f320-9a1d-4a34-be10-fd78dd51e579 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041067 May 25 17:16:12.257043 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 440/907] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:16:12.358586 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:12.360362 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:12.369156 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:12.369976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:12.370905 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:12.371591 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:12.412072 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:12.412736 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:12.413394 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lazy-loading 'fault' on Instance uuid 64a32d7a-f536-4bc3-8048-cfcb457b2881 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:16:12.469818 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:12.479097 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:12.481420 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41618b0540e64de4b968d5cdc39bea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197671139e6b42069ba82ea9fdf1da40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:12.482597 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-46359fe7-ca25-4ef6-bdf3-5383daeb7f72 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 200 len: 1370 microversion: 2.20 time: 0.133333 May 25 17:16:12.494109 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 468/908] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:16:12 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 17:16:13.502243 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-600bd3b3-393a-43a8-8c41-dedba5fe139e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:13.503062 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-600bd3b3-393a-43a8-8c41-dedba5fe139e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:13.509816 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-600bd3b3-393a-43a8-8c41-dedba5fe139e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:13.510270 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-600bd3b3-393a-43a8-8c41-dedba5fe139e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:13.511035 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-600bd3b3-393a-43a8-8c41-dedba5fe139e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:13.511472 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-600bd3b3-393a-43a8-8c41-dedba5fe139e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:13.525867 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-600bd3b3-393a-43a8-8c41-dedba5fe139e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] HTTP exception thrown: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-600bd3b3-393a-43a8-8c41-dedba5fe139e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Request method failure captured: May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 HTTP/1.1 May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLEZsihvNQ5PQTNLSdjMjiubDB7I6ybyx2g_U0ny8kESLyEmHUmePtdgO6aD3TVfoDROdphZLXTZyhKJrMbajhGodqR1VQg8Sva5WhyR-0xUQq_Nni5m6pl9qCcaScUpqnkUeCLIMfnYl62kJPrq4NmEM3uYRB0PCBbFJN2pXHcHfY May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Openstack-Nova-Api-Version: 2.20 May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:13.527650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}] May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 41618b0540e64de4b968d5cdc39bea0a May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:13.529385 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '64a32d7a-f536-4bc3-8048-cfcb457b2881'} May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:13.533980 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:13.535762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:13.537139 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-600bd3b3-393a-43a8-8c41-dedba5fe139e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Returning 404 to user: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:13.537139 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-600bd3b3-393a-43a8-8c41-dedba5fe139e tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 404 len: 111 microversion: 2.20 time: 0.031790 May 25 17:16:13.537139 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 441/909] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:16:13 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 17:16:13.542594 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0b61dcfc-f9c8-4604-8f5d-fe126f19a506 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '.version_select at 0x7f3d4e095430>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:13.561742 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0b61dcfc-f9c8-4604-8f5d-fe126f19a506 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844653568" status: 204 len: 0 microversion: 2.20 time: 0.023054 May 25 17:16:13.562409 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 469/910] 10.222.0.31 () {60 vars in 1261 bytes} [Wed May 25 17:16:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844653568 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 17:16:15.457392 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-47a66ca4-a6bd-478d-b9a9-964e5f0a3cdf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:15.458464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-47a66ca4-a6bd-478d-b9a9-964e5f0a3cdf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:15.465695 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-47a66ca4-a6bd-478d-b9a9-964e5f0a3cdf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:15.466353 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-47a66ca4-a6bd-478d-b9a9-964e5f0a3cdf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:15.467283 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-47a66ca4-a6bd-478d-b9a9-964e5f0a3cdf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:15.467749 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-47a66ca4-a6bd-478d-b9a9-964e5f0a3cdf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:15.482558 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-47a66ca4-a6bd-478d-b9a9-964e5f0a3cdf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] HTTP exception thrown: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-47a66ca4-a6bd-478d-b9a9-964e5f0a3cdf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Request method failure captured: May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 HTTP/1.1 May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLEZsihvNQ5PQTNLSdjMjiubDB7I6ybyx2g_U0ny8kESLyEmHUmePtdgO6aD3TVfoDROdphZLXTZyhKJrMbajhGodqR1VQg8Sva5WhyR-0xUQq_Nni5m6pl9qCcaScUpqnkUeCLIMfnYl62kJPrq4NmEM3uYRB0PCBbFJN2pXHcHfY May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Openstack-Nova-Api-Version: 2.20 May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:15.484194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}] May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 41618b0540e64de4b968d5cdc39bea0a May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:15.485930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '64a32d7a-f536-4bc3-8048-cfcb457b2881'} May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:15.486755 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:15.487932 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:15.489794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-47a66ca4-a6bd-478d-b9a9-964e5f0a3cdf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Returning 404 to user: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:15.489794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-47a66ca4-a6bd-478d-b9a9-964e5f0a3cdf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "DELETE /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 404 len: 111 microversion: 2.20 time: 0.032222 May 25 17:16:15.489794 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 442/911] 10.222.0.31 () {60 vars in 1279 bytes} [Wed May 25 17:16:15 2022] DELETE /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 25 17:16:15.496573 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0b7f023d-1f4f-4fb7-8e3b-9cd05b869783 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:15.498494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0b7f023d-1f4f-4fb7-8e3b-9cd05b869783 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: 64a32d7a-f536-4bc3-8048-cfcb457b2881] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:15.508311 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b7f023d-1f4f-4fb7-8e3b-9cd05b869783 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:15.508932 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b7f023d-1f4f-4fb7-8e3b-9cd05b869783 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:15.509845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b7f023d-1f4f-4fb7-8e3b-9cd05b869783 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:15.510419 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0b7f023d-1f4f-4fb7-8e3b-9cd05b869783 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:15.530697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-0b7f023d-1f4f-4fb7-8e3b-9cd05b869783 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] HTTP exception thrown: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0b7f023d-1f4f-4fb7-8e3b-9cd05b869783 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Request method failure captured: May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 HTTP/1.1 May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLEZsihvNQ5PQTNLSdjMjiubDB7I6ybyx2g_U0ny8kESLyEmHUmePtdgO6aD3TVfoDROdphZLXTZyhKJrMbajhGodqR1VQg8Sva5WhyR-0xUQq_Nni5m6pl9qCcaScUpqnkUeCLIMfnYl62kJPrq4NmEM3uYRB0PCBbFJN2pXHcHfY May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Openstack-Nova-Api-Version: 2.20 May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:15.532252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}] May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 41618b0540e64de4b968d5cdc39bea0a May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:15.533687 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '64a32d7a-f536-4bc3-8048-cfcb457b2881'} May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:15.534452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. May 25 17:16:15.536152 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:15.538587 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0b7f023d-1f4f-4fb7-8e3b-9cd05b869783 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Returning 404 to user: Instance 64a32d7a-f536-4bc3-8048-cfcb457b2881 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:15.538587 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0b7f023d-1f4f-4fb7-8e3b-9cd05b869783 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881" status: 404 len: 111 microversion: 2.20 time: 0.042007 May 25 17:16:15.538587 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 470/912] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:16:15 2022] GET /compute/v2.1/servers/64a32d7a-f536-4bc3-8048-cfcb457b2881 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 17:16:16.694284 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b7b5ad8b-9f29-4462-b9a0-accf7c0582d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:16.694869 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b7b5ad8b-9f29-4462-b9a0-accf7c0582d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:16.701513 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b7b5ad8b-9f29-4462-b9a0-accf7c0582d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:16.701985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b7b5ad8b-9f29-4462-b9a0-accf7c0582d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:16.702832 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b7b5ad8b-9f29-4462-b9a0-accf7c0582d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:16.703696 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b7b5ad8b-9f29-4462-b9a0-accf7c0582d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:16.708601 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:16.719077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-b7b5ad8b-9f29-4462-b9a0-accf7c0582d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] HTTP exception thrown: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b7b5ad8b-9f29-4462-b9a0-accf7c0582d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Request method failure captured: May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 HTTP/1.1 May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmLEZsihvNQ5PQTNLSdjMjiubDB7I6ybyx2g_U0ny8kESLyEmHUmePtdgO6aD3TVfoDROdphZLXTZyhKJrMbajhGodqR1VQg8Sva5WhyR-0xUQq_Nni5m6pl9qCcaScUpqnkUeCLIMfnYl62kJPrq4NmEM3uYRB0PCBbFJN2pXHcHfY May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Openstack-Nova-Api-Version: 2.20 May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:16.720719 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}] May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 41618b0540e64de4b968d5cdc39bea0a May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:16:16.723111 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'c99e2d9c-ac45-4a8e-8076-faaf830c29e0'} May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:16.724031 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:16:16.725530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:16.726978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b7b5ad8b-9f29-4462-b9a0-accf7c0582d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Returning 404 to user: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:16.726978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b7b5ad8b-9f29-4462-b9a0-accf7c0582d1 tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 404 len: 111 microversion: 2.20 time: 0.032102 May 25 17:16:16.726978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 443/913] 10.222.0.31 () {60 vars in 1279 bytes} [Wed May 25 17:16:16 2022] DELETE /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 17:16:16.731184 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e7007276-6ca9-4ca4-a5f5-b170dfcf37bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:16.731792 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e7007276-6ca9-4ca4-a5f5-b170dfcf37bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] [instance: c99e2d9c-ac45-4a8e-8076-faaf830c29e0] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:16.738273 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e7007276-6ca9-4ca4-a5f5-b170dfcf37bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:16.738989 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e7007276-6ca9-4ca4-a5f5-b170dfcf37bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:16.739753 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e7007276-6ca9-4ca4-a5f5-b170dfcf37bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:16.740197 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e7007276-6ca9-4ca4-a5f5-b170dfcf37bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:16.754033 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-e7007276-6ca9-4ca4-a5f5-b170dfcf37bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] HTTP exception thrown: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e7007276-6ca9-4ca4-a5f5-b170dfcf37bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Request method failure captured: May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 HTTP/1.1 May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmLEZsihvNQ5PQTNLSdjMjiubDB7I6ybyx2g_U0ny8kESLyEmHUmePtdgO6aD3TVfoDROdphZLXTZyhKJrMbajhGodqR1VQg8Sva5WhyR-0xUQq_Nni5m6pl9qCcaScUpqnkUeCLIMfnYl62kJPrq4NmEM3uYRB0PCBbFJN2pXHcHfY May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Openstack-Nova-Api-Version: 2.20 May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:16:16.756581 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/197671139e6b42069ba82ea9fdf1da40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/197671139e6b42069ba82ea9fdf1da40"}]}] May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 197671139e6b42069ba82ea9fdf1da40 May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-193424854 May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 41618b0540e64de4b968d5cdc39bea0a May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-193424854-project May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:16:16.758303 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': 'c99e2d9c-ac45-4a8e-8076-faaf830c29e0'} May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:16.759233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. May 25 17:16:16.760764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:16:16.762032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e7007276-6ca9-4ca4-a5f5-b170dfcf37bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] Returning 404 to user: Instance c99e2d9c-ac45-4a8e-8076-faaf830c29e0 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:16.762032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e7007276-6ca9-4ca4-a5f5-b170dfcf37bf tempest-AttachVolumeShelveTestJSON-193424854 tempest-AttachVolumeShelveTestJSON-193424854-project] 10.222.0.31 "GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0" status: 404 len: 111 microversion: 2.20 time: 0.030658 May 25 17:16:16.762032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 471/914] 10.222.0.31 () {60 vars in 1276 bytes} [Wed May 25 17:16:16 2022] GET /compute/v2.1/servers/c99e2d9c-ac45-4a8e-8076-faaf830c29e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 17:16:21.605768 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9f7d5318-e815-4fc8-ab93-8728b0965500 tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Action: 'create', calling method: .version_select at 0x7f3d4eb88ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1973039454", "metadata": {"Type": "work"}}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:16:21.888781 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9f7d5318-e815-4fc8-ab93-8728b0965500 tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.399099 May 25 17:16:21.889470 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 444/915] 10.222.0.31 () {60 vars in 1155 bytes} [Wed May 25 17:16:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 401 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 17:16:21.901024 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c46e9dd0-1720-49a8-bae4-9e461bf28108 tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Calling method '.version_select at 0x7f3d4e0b8820>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:21.953155 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c46e9dd0-1720-49a8-bae4-9e461bf28108 tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703" status: 200 len: 353 microversion: 2.1 time: 0.055844 May 25 17:16:21.953748 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 472/916] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:16:21 2022] GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:16:22.967062 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-59e7462b-4812-4240-9987-16869dfea94d tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Calling method '.version_select at 0x7f3d4eba2f70>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:23.017182 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-59e7462b-4812-4240-9987-16869dfea94d tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703" status: 200 len: 353 microversion: 2.1 time: 0.054311 May 25 17:16:23.017757 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 445/917] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:16:22 2022] GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:16:24.030354 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-063fbdf8-6be6-4e61-8849-2443861251d7 tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Calling method '.version_select at 0x7f3d4e0d2c10>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:24.084008 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-063fbdf8-6be6-4e61-8849-2443861251d7 tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703" status: 200 len: 353 microversion: 2.1 time: 0.058098 May 25 17:16:24.084564 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 473/918] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:16:24 2022] GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:16:25.096969 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-14d4f85f-dff9-4446-b5c6-fba0c49c1fb8 tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Calling method '.version_select at 0x7f3d4eac5040>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:25.146673 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-14d4f85f-dff9-4446-b5c6-fba0c49c1fb8 tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703" status: 200 len: 354 microversion: 2.1 time: 0.054266 May 25 17:16:25.147258 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 446/919] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:16:25 2022] GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:16:25.158603 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-bcd8fb4c-6f5f-445b-8f32-44390bbad36f tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Calling method '.version_select at 0x7f3d4e095430>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:25.208590 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-bcd8fb4c-6f5f-445b-8f32-44390bbad36f tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703" status: 200 len: 354 microversion: 2.1 time: 0.054105 May 25 17:16:25.209317 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 474/920] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:16:25 2022] GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:16:25.226443 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-da403ceb-609c-4901-896e-5171ef84820e tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Calling method '.version_select at 0x7f3d4eb88310>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:25.286543 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-da403ceb-609c-4901-896e-5171ef84820e tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703" status: 202 len: 0 microversion: 2.1 time: 0.064699 May 25 17:16:25.287332 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 447/921] 10.222.0.31 () {58 vars in 1247 bytes} [Wed May 25 17:16:25 2022] DELETE /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:16:25.306717 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-eba6df4b-3091-4530-aa74-b88ea54885f0 tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Calling method '.version_select at 0x7f3d4e0d73a0>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:25.377147 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-eba6df4b-3091-4530-aa74-b88ea54885f0 tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703" status: 200 len: 353 microversion: 2.1 time: 0.085226 May 25 17:16:25.377837 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 475/922] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:16:25 2022] GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:16:26.390382 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bf451e24-1579-4dda-9363-ca22606caedb tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Calling method '.version_select at 0x7f3d4eb1c310>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:26.418064 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-bf451e24-1579-4dda-9363-ca22606caedb tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] HTTP exception thrown: Volume 7fa1558a-589b-4d6c-aa6f-f8d26ff92703 could not be found. May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bf451e24-1579-4dda-9363-ca22606caedb tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Request method failure captured: May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703 HTTP/1.1 May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmRl7tiHfWgTn8IqyH91wY3bITgEsXcqr00T0fvPx3smY-hRXCHB0w7-FvLY6WkvVt7CKKcbol947uc5t3_ofNHO-sfx0PUZ5DdyBGfRcPkP-kwEvJLsyv7V9xofToJU3xwgo3bWijZgfyiN2zrI-wnpsfoToHCTkN38fbMsiU4EEG8 May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 84778f1b00884338bcd011f70ff14664 May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesGetTestJSON-333669652 May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:26.419983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_84778f1b00884338bcd011f70ff14664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/84778f1b00884338bcd011f70ff14664"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/84778f1b00884338bcd011f70ff14664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/84778f1b00884338bcd011f70ff14664"}]}] May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesGetTestJSON-333669652 May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 84778f1b00884338bcd011f70ff14664 May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesGetTestJSON-333669652 May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesGetTestJSON-333669652-project May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 768379d599c94cf8aca4d8cfb1a3852c May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesGetTestJSON-333669652-project May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Volume 7fa1558a-589b-4d6c-aa6f-f8d26ff92703 could not be found. May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '7fa1558a-589b-4d6c-aa6f-f8d26ff92703'} May 25 17:16:26.421606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7fa1558a-589b-4d6c-aa6f-f8d26ff92703 could not be found. (HTTP 404) (Request-ID: req-aeff6d6d-a961-486f-bfe0-5127a2e957d9) May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:26.422590 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 17:16:26.423995 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7fa1558a-589b-4d6c-aa6f-f8d26ff92703 could not be found. May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 17:16:26.426166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7fa1558a-589b-4d6c-aa6f-f8d26ff92703 could not be found. May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7fa1558a-589b-4d6c-aa6f-f8d26ff92703 could not be found. May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bf451e24-1579-4dda-9363-ca22606caedb tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] Returning 404 to user: Volume 7fa1558a-589b-4d6c-aa6f-f8d26ff92703 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bf451e24-1579-4dda-9363-ca22606caedb tempest-VolumesGetTestJSON-333669652 tempest-VolumesGetTestJSON-333669652-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703" status: 404 len: 109 microversion: 2.1 time: 0.035664 May 25 17:16:26.427530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 448/923] 10.222.0.31 () {58 vars in 1244 bytes} [Wed May 25 17:16:26 2022] GET /compute/v2.1/os-volumes/7fa1558a-589b-4d6c-aa6f-f8d26ff92703 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:34.255618 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:34.257219 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=31 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:34.259151 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:34.260578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-a0147ae8-b48d-4410-865a-04893fb62675 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:34.260745 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:34.261155 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a0147ae8-b48d-4410-865a-04893fb62675 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:34.265026 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-9b72a574-2311-4202-b92d-c26128a21b89 req-bcd443cb-642c-44b8-bec0-d3cb5d25c5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b7231c-3070-4cb3-b6a2-732af750f6f4", "tag": "fc321a82-a17f-45cd-ae89-dea85055e57c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:16:34.276659 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-9b72a574-2311-4202-b92d-c26128a21b89 req-bcd443cb-642c-44b8-bec0-d3cb5d25c5a3 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:34.277150 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-9b72a574-2311-4202-b92d-c26128a21b89 req-bcd443cb-642c-44b8-bec0-d3cb5d25c5a3 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:34.278706 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a0147ae8-b48d-4410-865a-04893fb62675 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:34.279155 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a0147ae8-b48d-4410-865a-04893fb62675 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:34.280121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a0147ae8-b48d-4410-865a-04893fb62675 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:34.285561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-a0147ae8-b48d-4410-865a-04893fb62675 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:34.289411 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-9b72a574-2311-4202-b92d-c26128a21b89 req-bcd443cb-642c-44b8-bec0-d3cb5d25c5a3 service nova] Creating event network-changed:fc321a82-a17f-45cd-ae89-dea85055e57c for instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 on hv-cinder-84330 May 25 17:16:34.294914 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-9b72a574-2311-4202-b92d-c26128a21b89 req-bcd443cb-642c-44b8-bec0-d3cb5d25c5a3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036320 May 25 17:16:34.295731 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 449/924] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:16:34.325180 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-a0147ae8-b48d-4410-865a-04893fb62675 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:16:34.413355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-a0147ae8-b48d-4410-865a-04893fb62675 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 204 len: 0 microversion: 2.1 time: 0.159050 May 25 17:16:34.417583 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 476/925] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:16:34 2022] DELETE /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:16:34.424993 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-808ef299-85a2-4199-bb9e-b40e1bceead9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:34.425788 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-808ef299-85a2-4199-bb9e-b40e1bceead9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:34.434223 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-808ef299-85a2-4199-bb9e-b40e1bceead9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:34.435044 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-808ef299-85a2-4199-bb9e-b40e1bceead9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:34.436246 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-808ef299-85a2-4199-bb9e-b40e1bceead9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:34.436885 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-808ef299-85a2-4199-bb9e-b40e1bceead9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:34.590598 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-808ef299-85a2-4199-bb9e-b40e1bceead9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:34.600096 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-808ef299-85a2-4199-bb9e-b40e1bceead9 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.180803 May 25 17:16:34.600991 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 450/926] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:34 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:16:35.619512 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-df035016-c101-4d42-b076-ee5b94c3197d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:35.620203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-df035016-c101-4d42-b076-ee5b94c3197d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:35.626552 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df035016-c101-4d42-b076-ee5b94c3197d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:35.626999 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df035016-c101-4d42-b076-ee5b94c3197d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:35.628419 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df035016-c101-4d42-b076-ee5b94c3197d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:35.628878 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-df035016-c101-4d42-b076-ee5b94c3197d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:35.769027 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-df035016-c101-4d42-b076-ee5b94c3197d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:35.776451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-df035016-c101-4d42-b076-ee5b94c3197d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.161188 May 25 17:16:35.777044 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 477/927] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:35 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:36.993256 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5e5c3e0b-4237-40ed-8782-35fceee9943b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:36.993846 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5e5c3e0b-4237-40ed-8782-35fceee9943b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:37.000138 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5e5c3e0b-4237-40ed-8782-35fceee9943b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:37.000587 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5e5c3e0b-4237-40ed-8782-35fceee9943b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:37.001688 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5e5c3e0b-4237-40ed-8782-35fceee9943b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:37.002487 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5e5c3e0b-4237-40ed-8782-35fceee9943b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:37.155929 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5e5c3e0b-4237-40ed-8782-35fceee9943b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:37.165115 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5e5c3e0b-4237-40ed-8782-35fceee9943b tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.374543 May 25 17:16:37.165798 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 451/928] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:36 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:38.182095 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5bb4d2ff-26b4-435d-8e54-872340016869 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:38.182724 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5bb4d2ff-26b4-435d-8e54-872340016869 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:38.189405 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5bb4d2ff-26b4-435d-8e54-872340016869 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:38.189863 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5bb4d2ff-26b4-435d-8e54-872340016869 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:38.190635 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5bb4d2ff-26b4-435d-8e54-872340016869 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:38.191077 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5bb4d2ff-26b4-435d-8e54-872340016869 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:38.329514 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5bb4d2ff-26b4-435d-8e54-872340016869 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:38.350167 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5bb4d2ff-26b4-435d-8e54-872340016869 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1568 microversion: 2.1 time: 0.171815 May 25 17:16:38.351233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 478/929] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:38 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:38.977814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-3a4cb11c-48ef-4f31-b5a6-d7af4ad7b49b req-8e711e0b-6c1e-4ac7-a2bb-0fc3c93db122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b7231c-3070-4cb3-b6a2-732af750f6f4", "name": "network-vif-deleted", "tag": "fc321a82-a17f-45cd-ae89-dea85055e57c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:16:38.986754 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-3a4cb11c-48ef-4f31-b5a6-d7af4ad7b49b req-8e711e0b-6c1e-4ac7-a2bb-0fc3c93db122 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:38.987205 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-3a4cb11c-48ef-4f31-b5a6-d7af4ad7b49b req-8e711e0b-6c1e-4ac7-a2bb-0fc3c93db122 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:38.998851 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-3a4cb11c-48ef-4f31-b5a6-d7af4ad7b49b req-8e711e0b-6c1e-4ac7-a2bb-0fc3c93db122 service nova] Creating event network-vif-deleted:fc321a82-a17f-45cd-ae89-dea85055e57c for instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 on hv-cinder-84330 May 25 17:16:39.003499 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-3a4cb11c-48ef-4f31-b5a6-d7af4ad7b49b req-8e711e0b-6c1e-4ac7-a2bb-0fc3c93db122 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029989 May 25 17:16:39.004077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 452/930] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:16:39.368149 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-aeba90a4-d62b-47ee-80dc-b7d4b83ac61d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:39.368968 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-aeba90a4-d62b-47ee-80dc-b7d4b83ac61d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:39.375649 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aeba90a4-d62b-47ee-80dc-b7d4b83ac61d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:39.376106 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aeba90a4-d62b-47ee-80dc-b7d4b83ac61d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:39.376913 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aeba90a4-d62b-47ee-80dc-b7d4b83ac61d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:39.377357 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-aeba90a4-d62b-47ee-80dc-b7d4b83ac61d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:39.442474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-aeba90a4-d62b-47ee-80dc-b7d4b83ac61d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:39.450142 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-aeba90a4-d62b-47ee-80dc-b7d4b83ac61d tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1382 microversion: 2.1 time: 0.086719 May 25 17:16:39.450715 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 479/931] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:39 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:40.468507 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-021a6934-fb13-4635-9a76-1649f64e8ca2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:40.469230 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-021a6934-fb13-4635-9a76-1649f64e8ca2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:40.475880 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-021a6934-fb13-4635-9a76-1649f64e8ca2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:40.476337 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-021a6934-fb13-4635-9a76-1649f64e8ca2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:40.477142 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-021a6934-fb13-4635-9a76-1649f64e8ca2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:40.477582 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-021a6934-fb13-4635-9a76-1649f64e8ca2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:40.543141 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-021a6934-fb13-4635-9a76-1649f64e8ca2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:40.550813 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-021a6934-fb13-4635-9a76-1649f64e8ca2 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1382 microversion: 2.1 time: 0.086955 May 25 17:16:40.551433 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 453/932] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:40 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:41.573254 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-30e4f53d-50da-49b5-9561-1c1c336a10df tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:41.573861 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-30e4f53d-50da-49b5-9561-1c1c336a10df tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:41.580162 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-30e4f53d-50da-49b5-9561-1c1c336a10df tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:41.580604 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-30e4f53d-50da-49b5-9561-1c1c336a10df tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:41.581452 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-30e4f53d-50da-49b5-9561-1c1c336a10df tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:41.581884 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-30e4f53d-50da-49b5-9561-1c1c336a10df tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:41.643633 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-30e4f53d-50da-49b5-9561-1c1c336a10df tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f7eb5295ad40df898f93f1505a7df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d67075f4eaf4908acb0c2763153b81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:41.651741 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-30e4f53d-50da-49b5-9561-1c1c336a10df tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 200 len: 1220 microversion: 2.1 time: 0.082191 May 25 17:16:41.652309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 480/933] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:41 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:42.669962 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0c959d1c-5707-4061-9a31-9084c1d25298 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:42.670507 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0c959d1c-5707-4061-9a31-9084c1d25298 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] [instance: d2b7231c-3070-4cb3-b6a2-732af750f6f4] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:42.678450 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c959d1c-5707-4061-9a31-9084c1d25298 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:42.678908 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c959d1c-5707-4061-9a31-9084c1d25298 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:42.679760 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c959d1c-5707-4061-9a31-9084c1d25298 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:42.680106 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c959d1c-5707-4061-9a31-9084c1d25298 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:42.694893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-0c959d1c-5707-4061-9a31-9084c1d25298 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] HTTP exception thrown: Instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 could not be found. May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0c959d1c-5707-4061-9a31-9084c1d25298 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Request method failure captured: May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 HTTP/1.1 May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmM5YOzHUBkni899GKm2J2I7fvNBP6UY3U0U1LlxAvSKqDv8Z5nErwXJAftYBxsCwpPISnDHOAkzviu14Sv-8YrsIXr5HJi99eZ6d7waogI9G_UvqxlEEDoNIi6FMvH6hQiVjDtu1Fy5husiy2OElM5CM8g8yybbEDzrTBEsLrkIklU May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 1d67075f4eaf4908acb0c2763153b81c May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-TestShelveInstance-1160096262 May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:16:42.696552 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_1d67075f4eaf4908acb0c2763153b81c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/1d67075f4eaf4908acb0c2763153b81c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/1d67075f4eaf4908acb0c2763153b81c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/1d67075f4eaf4908acb0c2763153b81c"}]}] May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-TestShelveInstance-1160096262 May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 1d67075f4eaf4908acb0c2763153b81c May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-TestShelveInstance-1160096262 May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-TestShelveInstance-1160096262-project May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 96f7eb5295ad40df898f93f1505a7df7 May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-TestShelveInstance-1160096262-project May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 could not be found. May 25 17:16:42.698297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'd2b7231c-3070-4cb3-b6a2-732af750f6f4'} May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 could not be found. May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:16:42.699158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 could not be found. May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 could not be found. May 25 17:16:42.700510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:16:42.701753 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0c959d1c-5707-4061-9a31-9084c1d25298 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Returning 404 to user: Instance d2b7231c-3070-4cb3-b6a2-732af750f6f4 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:16:42.701753 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0c959d1c-5707-4061-9a31-9084c1d25298 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4" status: 404 len: 111 microversion: 2.1 time: 0.032128 May 25 17:16:42.701753 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 454/934] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:42 2022] GET /compute/v2.1/servers/d2b7231c-3070-4cb3-b6a2-732af750f6f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:16:42.876196 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-15b8fa1d-fb60-4669-aa30-978549817999 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] Calling method '.version_select at 0x7f3d4e0d29d0>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:42.902712 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-15b8fa1d-fb60-4669-aa30-978549817999 tempest-TestShelveInstance-1160096262 tempest-TestShelveInstance-1160096262-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1368124714" status: 202 len: 0 microversion: 2.1 time: 0.030804 May 25 17:16:42.903601 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 481/935] 10.222.0.31 () {58 vars in 1253 bytes} [Wed May 25 17:16:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1368124714 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:16:48.186638 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-190553635", "imageRef": "b1e7c568-68ff-42ae-bde5-85431e4c6baa", "flavorRef": "452"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:16:48.256506 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] validate_networks() for None {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:16:48.681595 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:16:48.682242 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:16:48.682874 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:16:48.683452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:16:48.683866 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:16:48.694586 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:48.695297 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:48.696435 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:48.696744 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:48.715971 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Getting quotas for project cb64651a79ca496dbf2a79dba7e085ff. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:16:48.720377 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Getting quotas for user 1ec72d8adbb84b32a74b3c85a260c6a2 and project cb64651a79ca496dbf2a79dba7e085ff. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:16:48.733121 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:16:48.735398 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1e7c568-68ff-42ae-bde5-85431e4c6baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:16:48.788127 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-68e4be42-4e39-4626-a3ff-639d9edd5ae3 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605456 May 25 17:16:48.793920 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 455/936] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:16:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:16:48.801364 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1cbccfcc-87a0-4194-876d-ae3dad03e1c7 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:48.803139 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1cbccfcc-87a0-4194-876d-ae3dad03e1c7 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:48.926586 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1cbccfcc-87a0-4194-876d-ae3dad03e1c7 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:48.936032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1cbccfcc-87a0-4194-876d-ae3dad03e1c7 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1214 microversion: 2.1 time: 0.140545 May 25 17:16:48.936804 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 482/937] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:48 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:16:49.954992 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9c98efdf-5aba-4bca-971b-70c6c7aa23b4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:49.955604 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9c98efdf-5aba-4bca-971b-70c6c7aa23b4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:49.966050 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9c98efdf-5aba-4bca-971b-70c6c7aa23b4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:49.966646 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9c98efdf-5aba-4bca-971b-70c6c7aa23b4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:49.967455 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9c98efdf-5aba-4bca-971b-70c6c7aa23b4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:49.967899 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9c98efdf-5aba-4bca-971b-70c6c7aa23b4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:50.102255 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9c98efdf-5aba-4bca-971b-70c6c7aa23b4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:50.122848 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9c98efdf-5aba-4bca-971b-70c6c7aa23b4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1274 microversion: 2.1 time: 0.171812 May 25 17:16:50.127359 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 456/938] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:49 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:51.147107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2d3637dd-3820-4be8-8856-da91e9beda2e tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:51.147751 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2d3637dd-3820-4be8-8856-da91e9beda2e tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:51.154394 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2d3637dd-3820-4be8-8856-da91e9beda2e tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:51.154851 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2d3637dd-3820-4be8-8856-da91e9beda2e tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:51.155628 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2d3637dd-3820-4be8-8856-da91e9beda2e tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:51.156070 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2d3637dd-3820-4be8-8856-da91e9beda2e tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:51.231791 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2d3637dd-3820-4be8-8856-da91e9beda2e tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:51.239653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2d3637dd-3820-4be8-8856-da91e9beda2e tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1272 microversion: 2.1 time: 0.097196 May 25 17:16:51.240314 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 483/939] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:51 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:52.256616 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-75013ed0-8475-4a7a-a256-93ec4e31bede tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:52.257194 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-75013ed0-8475-4a7a-a256-93ec4e31bede tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:52.263786 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75013ed0-8475-4a7a-a256-93ec4e31bede tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:52.264237 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75013ed0-8475-4a7a-a256-93ec4e31bede tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:52.265028 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75013ed0-8475-4a7a-a256-93ec4e31bede tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:52.265467 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75013ed0-8475-4a7a-a256-93ec4e31bede tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:52.328490 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-75013ed0-8475-4a7a-a256-93ec4e31bede tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:52.336092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-75013ed0-8475-4a7a-a256-93ec4e31bede tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1272 microversion: 2.1 time: 0.083524 May 25 17:16:52.336661 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 457/940] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:52 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:53.353403 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-37b20b99-744b-4e93-8465-9cb53b5aad0c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:53.354044 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-37b20b99-744b-4e93-8465-9cb53b5aad0c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:53.360817 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-37b20b99-744b-4e93-8465-9cb53b5aad0c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:53.361268 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-37b20b99-744b-4e93-8465-9cb53b5aad0c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:53.362233 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-37b20b99-744b-4e93-8465-9cb53b5aad0c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:53.362677 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-37b20b99-744b-4e93-8465-9cb53b5aad0c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:53.425808 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-37b20b99-744b-4e93-8465-9cb53b5aad0c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:53.433813 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-37b20b99-744b-4e93-8465-9cb53b5aad0c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1272 microversion: 2.1 time: 0.084577 May 25 17:16:53.434374 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 484/941] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:53 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:54.369951 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-5bfd87d2-8179-42a2-98ff-7153c7b398ad req-3d2d02a6-75bb-47ac-a242-d0102a29dd0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a1a19c-745a-4bd6-ac50-edfee196c266", "tag": "85da7279-5d3c-4665-857f-576fbbdcc8fc"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:16:54.390168 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-5bfd87d2-8179-42a2-98ff-7153c7b398ad req-3d2d02a6-75bb-47ac-a242-d0102a29dd0f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:54.390953 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-5bfd87d2-8179-42a2-98ff-7153c7b398ad req-3d2d02a6-75bb-47ac-a242-d0102a29dd0f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:54.405902 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-5bfd87d2-8179-42a2-98ff-7153c7b398ad req-3d2d02a6-75bb-47ac-a242-d0102a29dd0f service nova] Creating event network-changed:85da7279-5d3c-4665-857f-576fbbdcc8fc for instance 99a1a19c-745a-4bd6-ac50-edfee196c266 on hv-cinder-84330 May 25 17:16:54.413144 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-5bfd87d2-8179-42a2-98ff-7153c7b398ad req-3d2d02a6-75bb-47ac-a242-d0102a29dd0f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052866 May 25 17:16:54.414406 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 458/942] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:16:54.451961 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-de764db4-24d3-4c7c-9073-7b4ab9617e4c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:54.453050 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-de764db4-24d3-4c7c-9073-7b4ab9617e4c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:54.460555 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-de764db4-24d3-4c7c-9073-7b4ab9617e4c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:54.461385 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-de764db4-24d3-4c7c-9073-7b4ab9617e4c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:54.462460 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-de764db4-24d3-4c7c-9073-7b4ab9617e4c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:54.463519 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-de764db4-24d3-4c7c-9073-7b4ab9617e4c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:54.608736 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-de764db4-24d3-4c7c-9073-7b4ab9617e4c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:54.617816 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-de764db4-24d3-4c7c-9073-7b4ab9617e4c tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1314 microversion: 2.1 time: 0.169814 May 25 17:16:54.619037 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 485/943] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:54 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:55.636762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-428b5156-cacd-4fd4-9c49-c0627f469b7f tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:55.637505 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-428b5156-cacd-4fd4-9c49-c0627f469b7f tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:55.643816 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-428b5156-cacd-4fd4-9c49-c0627f469b7f tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:55.644268 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-428b5156-cacd-4fd4-9c49-c0627f469b7f tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:55.645200 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-428b5156-cacd-4fd4-9c49-c0627f469b7f tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:55.645636 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-428b5156-cacd-4fd4-9c49-c0627f469b7f tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:55.862925 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-428b5156-cacd-4fd4-9c49-c0627f469b7f tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:55.870887 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-428b5156-cacd-4fd4-9c49-c0627f469b7f tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1314 microversion: 2.1 time: 0.238982 May 25 17:16:55.873570 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 459/944] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:55 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:56.888322 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4329f8d2-84b7-4736-a29c-2b8f2fc70979 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:56.888950 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4329f8d2-84b7-4736-a29c-2b8f2fc70979 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:56.896016 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4329f8d2-84b7-4736-a29c-2b8f2fc70979 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:56.896525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4329f8d2-84b7-4736-a29c-2b8f2fc70979 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:56.897583 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4329f8d2-84b7-4736-a29c-2b8f2fc70979 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:56.898019 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4329f8d2-84b7-4736-a29c-2b8f2fc70979 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:57.033122 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4329f8d2-84b7-4736-a29c-2b8f2fc70979 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:57.040620 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4329f8d2-84b7-4736-a29c-2b8f2fc70979 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1314 microversion: 2.1 time: 0.156145 May 25 17:16:57.041204 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 486/945] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:56 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:58.057489 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f47111cf-35a2-4230-8ebe-41e295de3740 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:58.058030 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f47111cf-35a2-4230-8ebe-41e295de3740 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:58.066001 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f47111cf-35a2-4230-8ebe-41e295de3740 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:58.066703 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f47111cf-35a2-4230-8ebe-41e295de3740 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:58.067752 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f47111cf-35a2-4230-8ebe-41e295de3740 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:58.068360 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f47111cf-35a2-4230-8ebe-41e295de3740 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:58.202999 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-c6cbb649-cb7b-4669-aad0-7a30bc5ac7ea req-32804cb1-fd5a-4466-9395-d96b063036af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a1a19c-745a-4bd6-ac50-edfee196c266", "name": "network-vif-plugged", "status": "completed", "tag": "85da7279-5d3c-4665-857f-576fbbdcc8fc"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:16:58.216143 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-c6cbb649-cb7b-4669-aad0-7a30bc5ac7ea req-32804cb1-fd5a-4466-9395-d96b063036af service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:58.216493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-c6cbb649-cb7b-4669-aad0-7a30bc5ac7ea req-32804cb1-fd5a-4466-9395-d96b063036af service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:58.229760 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-c6cbb649-cb7b-4669-aad0-7a30bc5ac7ea req-32804cb1-fd5a-4466-9395-d96b063036af service nova] Creating event network-vif-plugged:85da7279-5d3c-4665-857f-576fbbdcc8fc for instance 99a1a19c-745a-4bd6-ac50-edfee196c266 on hv-cinder-84330 May 25 17:16:58.235067 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-c6cbb649-cb7b-4669-aad0-7a30bc5ac7ea req-32804cb1-fd5a-4466-9395-d96b063036af service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036394 May 25 17:16:58.236008 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 487/946] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:16:58.269504 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f47111cf-35a2-4230-8ebe-41e295de3740 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:58.278328 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f47111cf-35a2-4230-8ebe-41e295de3740 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1314 microversion: 2.1 time: 0.224838 May 25 17:16:58.278913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 460/947] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:58 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:16:59.294409 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:59.299115 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-836201ce-4346-4ccb-98cf-d8930009ecc9 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:16:59.299818 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-836201ce-4346-4ccb-98cf-d8930009ecc9 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:16:59.307035 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-836201ce-4346-4ccb-98cf-d8930009ecc9 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:59.307493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-836201ce-4346-4ccb-98cf-d8930009ecc9 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:59.308263 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-836201ce-4346-4ccb-98cf-d8930009ecc9 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:16:59.308751 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-836201ce-4346-4ccb-98cf-d8930009ecc9 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:16:59.446925 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-836201ce-4346-4ccb-98cf-d8930009ecc9 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:16:59.454660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-836201ce-4346-4ccb-98cf-d8930009ecc9 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1314 microversion: 2.1 time: 0.161147 May 25 17:16:59.455208 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 488/948] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:16:59 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:00.472339 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-07694c4a-85f3-4980-a7d2-48fe6b20103d tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:00.472973 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-07694c4a-85f3-4980-a7d2-48fe6b20103d tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:00.477099 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:00.477772 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:00.483185 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07694c4a-85f3-4980-a7d2-48fe6b20103d tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:00.483743 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07694c4a-85f3-4980-a7d2-48fe6b20103d tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:00.484412 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07694c4a-85f3-4980-a7d2-48fe6b20103d tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:00.484904 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07694c4a-85f3-4980-a7d2-48fe6b20103d tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:00.639179 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-07694c4a-85f3-4980-a7d2-48fe6b20103d tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:00.647383 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-07694c4a-85f3-4980-a7d2-48fe6b20103d tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1314 microversion: 2.1 time: 0.178787 May 25 17:17:00.647949 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 461/949] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:00 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:01.664100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d978ca2c-3f17-4030-a59a-e2c6ff7667f4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:01.664739 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d978ca2c-3f17-4030-a59a-e2c6ff7667f4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:01.671664 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d978ca2c-3f17-4030-a59a-e2c6ff7667f4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:01.671936 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d978ca2c-3f17-4030-a59a-e2c6ff7667f4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:01.672693 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d978ca2c-3f17-4030-a59a-e2c6ff7667f4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:01.673161 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d978ca2c-3f17-4030-a59a-e2c6ff7667f4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:01.803069 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d978ca2c-3f17-4030-a59a-e2c6ff7667f4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:01.810692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d978ca2c-3f17-4030-a59a-e2c6ff7667f4 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1314 microversion: 2.1 time: 0.151186 May 25 17:17:01.811254 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 489/950] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:01 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:17:02.828221 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0bd8c897-f7b5-4052-8e79-2ff4310ad41a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:02.828856 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0bd8c897-f7b5-4052-8e79-2ff4310ad41a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:02.835380 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0bd8c897-f7b5-4052-8e79-2ff4310ad41a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:02.835824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0bd8c897-f7b5-4052-8e79-2ff4310ad41a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:02.836574 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0bd8c897-f7b5-4052-8e79-2ff4310ad41a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:02.837034 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0bd8c897-f7b5-4052-8e79-2ff4310ad41a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:02.969595 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0bd8c897-f7b5-4052-8e79-2ff4310ad41a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:02.977870 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0bd8c897-f7b5-4052-8e79-2ff4310ad41a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1464 microversion: 2.1 time: 0.153604 May 25 17:17:02.978449 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 462/951] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:02 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:03.018747 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-35dd9fd8-f316-4f52-859f-3e1745641438 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:03.020665 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-35dd9fd8-f316-4f52-859f-3e1745641438 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:03.026986 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-35dd9fd8-f316-4f52-859f-3e1745641438 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:03.027838 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-35dd9fd8-f316-4f52-859f-3e1745641438 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:03.028823 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-35dd9fd8-f316-4f52-859f-3e1745641438 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:03.029526 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-35dd9fd8-f316-4f52-859f-3e1745641438 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:03.056503 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-35dd9fd8-f316-4f52-859f-3e1745641438 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:17:03.131601 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-35dd9fd8-f316-4f52-859f-3e1745641438 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "DELETE /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 204 len: 0 microversion: 2.1 time: 0.116518 May 25 17:17:03.132214 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 490/952] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:17:03 2022] DELETE /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:17:03.141815 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d6ecab24-860b-4ad7-9aae-6408b97b59c6 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:03.142430 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d6ecab24-860b-4ad7-9aae-6408b97b59c6 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:03.148637 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6ecab24-860b-4ad7-9aae-6408b97b59c6 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:03.149140 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6ecab24-860b-4ad7-9aae-6408b97b59c6 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:03.149909 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6ecab24-860b-4ad7-9aae-6408b97b59c6 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:03.150350 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6ecab24-860b-4ad7-9aae-6408b97b59c6 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:03.284780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d6ecab24-860b-4ad7-9aae-6408b97b59c6 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:03.293178 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d6ecab24-860b-4ad7-9aae-6408b97b59c6 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1470 microversion: 2.1 time: 0.156511 May 25 17:17:03.293743 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 463/953] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:03 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:04.335561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-100a81c6-e2a9-4927-8c5b-309b59318752 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:04.335561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-100a81c6-e2a9-4927-8c5b-309b59318752 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:04.343850 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:04.355165 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-100a81c6-e2a9-4927-8c5b-309b59318752 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:04.356268 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-100a81c6-e2a9-4927-8c5b-309b59318752 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:04.357635 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-100a81c6-e2a9-4927-8c5b-309b59318752 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:04.358346 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-100a81c6-e2a9-4927-8c5b-309b59318752 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:04.384177 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:04.393783 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ecc3b836-b3a4-4e8c-95a6-c3002eab7f0a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:04.394638 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ecc3b836-b3a4-4e8c-95a6-c3002eab7f0a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:04.410070 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:04.417452 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ecc3b836-b3a4-4e8c-95a6-c3002eab7f0a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:04.429219 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ecc3b836-b3a4-4e8c-95a6-c3002eab7f0a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:04.430675 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ecc3b836-b3a4-4e8c-95a6-c3002eab7f0a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:04.431442 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ecc3b836-b3a4-4e8c-95a6-c3002eab7f0a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:04.450555 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=71 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:04.501204 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ecc3b836-b3a4-4e8c-95a6-c3002eab7f0a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:17:04.565679 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-100a81c6-e2a9-4927-8c5b-309b59318752 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:04.575948 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-100a81c6-e2a9-4927-8c5b-309b59318752 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1470 microversion: 2.1 time: 0.268236 May 25 17:17:04.576417 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 491/954] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:04 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:04.625093 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ecc3b836-b3a4-4e8c-95a6-c3002eab7f0a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 204 len: 0 microversion: 2.1 time: 0.237539 May 25 17:17:04.628766 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 464/955] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:17:04 2022] DELETE /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:17:04.637008 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7965f6f4-bda5-48e8-8129-84aaa98a71a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:04.637619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7965f6f4-bda5-48e8-8129-84aaa98a71a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:04.652814 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7965f6f4-bda5-48e8-8129-84aaa98a71a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:04.653275 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7965f6f4-bda5-48e8-8129-84aaa98a71a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:04.654058 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7965f6f4-bda5-48e8-8129-84aaa98a71a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:04.654680 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7965f6f4-bda5-48e8-8129-84aaa98a71a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:04.792182 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7965f6f4-bda5-48e8-8129-84aaa98a71a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:04.799681 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7965f6f4-bda5-48e8-8129-84aaa98a71a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1577 microversion: 2.1 time: 0.166463 May 25 17:17:04.800244 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 492/956] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:04 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:05.056233 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-494f6a13-f74c-4ead-9247-91e1a948a6af req-80ce0d5b-fb3b-45e0-ab2c-74276dd079dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a1a19c-745a-4bd6-ac50-edfee196c266", "name": "network-vif-deleted", "tag": "85da7279-5d3c-4665-857f-576fbbdcc8fc"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:17:05.064898 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-494f6a13-f74c-4ead-9247-91e1a948a6af req-80ce0d5b-fb3b-45e0-ab2c-74276dd079dc service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:05.065443 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-494f6a13-f74c-4ead-9247-91e1a948a6af req-80ce0d5b-fb3b-45e0-ab2c-74276dd079dc service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:05.077510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-494f6a13-f74c-4ead-9247-91e1a948a6af req-80ce0d5b-fb3b-45e0-ab2c-74276dd079dc service nova] Creating event network-vif-deleted:85da7279-5d3c-4665-857f-576fbbdcc8fc for instance 99a1a19c-745a-4bd6-ac50-edfee196c266 on hv-cinder-84330 May 25 17:17:05.082400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-494f6a13-f74c-4ead-9247-91e1a948a6af req-80ce0d5b-fb3b-45e0-ab2c-74276dd079dc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031231 May 25 17:17:05.083066 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 465/957] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:17:05.594451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-9838fede-828b-449e-8aa1-2b9f50dc8718 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:05.595066 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-9838fede-828b-449e-8aa1-2b9f50dc8718 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:05.602960 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9838fede-828b-449e-8aa1-2b9f50dc8718 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:05.603571 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9838fede-828b-449e-8aa1-2b9f50dc8718 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:05.604549 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9838fede-828b-449e-8aa1-2b9f50dc8718 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:05.605172 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-9838fede-828b-449e-8aa1-2b9f50dc8718 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:05.669448 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-9838fede-828b-449e-8aa1-2b9f50dc8718 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:05.685762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-9838fede-828b-449e-8aa1-2b9f50dc8718 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1428 microversion: 2.1 time: 0.095076 May 25 17:17:05.697746 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 493/958] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:05 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:05.819791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-88e72169-f419-411b-a79e-ab951708244c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:05.821565 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-88e72169-f419-411b-a79e-ab951708244c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:05.830653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-88e72169-f419-411b-a79e-ab951708244c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:05.831356 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-88e72169-f419-411b-a79e-ab951708244c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:05.832598 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-88e72169-f419-411b-a79e-ab951708244c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:05.844751 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-88e72169-f419-411b-a79e-ab951708244c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:05.996654 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-88e72169-f419-411b-a79e-ab951708244c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:06.006535 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-88e72169-f419-411b-a79e-ab951708244c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1577 microversion: 2.1 time: 0.191487 May 25 17:17:06.007636 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 466/959] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:05 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:17:06.704716 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:06.705366 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:06.711923 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:06.712379 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:06.713238 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:06.713681 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:06.744252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:06.744736 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:06.745195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lazy-loading 'fault' on Instance uuid 99a1a19c-745a-4bd6-ac50-edfee196c266 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:17:06.789897 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:06.797512 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8ca3bff1-b8b7-493f-a699-1e69185ee70a tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1304 microversion: 2.1 time: 0.096841 May 25 17:17:06.798078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 494/960] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:06 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:07.024951 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8bf7d129-80ce-4b80-8c23-faa4e32c966f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:07.025625 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8bf7d129-80ce-4b80-8c23-faa4e32c966f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:07.032038 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8bf7d129-80ce-4b80-8c23-faa4e32c966f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:07.032494 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8bf7d129-80ce-4b80-8c23-faa4e32c966f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:07.033305 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8bf7d129-80ce-4b80-8c23-faa4e32c966f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:07.033743 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8bf7d129-80ce-4b80-8c23-faa4e32c966f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:07.176820 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8bf7d129-80ce-4b80-8c23-faa4e32c966f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:07.186957 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8bf7d129-80ce-4b80-8c23-faa4e32c966f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1577 microversion: 2.1 time: 0.166209 May 25 17:17:07.187863 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 467/961] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:07 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:07.815491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:07.816134 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:07.823656 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:07.824158 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:07.825030 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:07.825460 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:07.867010 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:07.867459 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:07.867913 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lazy-loading 'fault' on Instance uuid 99a1a19c-745a-4bd6-ac50-edfee196c266 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:17:07.921927 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:07.929827 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-789e9e2d-b47f-42ea-b704-c93191049b78 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1304 microversion: 2.1 time: 0.118133 May 25 17:17:07.930404 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 495/962] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:07 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:08.205935 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bc20c5a5-0e13-47cb-a176-fda3dccd368d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:08.206893 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bc20c5a5-0e13-47cb-a176-fda3dccd368d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:08.214549 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bc20c5a5-0e13-47cb-a176-fda3dccd368d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:08.215191 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bc20c5a5-0e13-47cb-a176-fda3dccd368d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:08.216175 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bc20c5a5-0e13-47cb-a176-fda3dccd368d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:08.216841 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bc20c5a5-0e13-47cb-a176-fda3dccd368d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:08.424830 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bc20c5a5-0e13-47cb-a176-fda3dccd368d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:08.433283 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bc20c5a5-0e13-47cb-a176-fda3dccd368d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1577 microversion: 2.1 time: 0.232395 May 25 17:17:08.433882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 468/963] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:08 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:08.948216 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:08.949145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:08.956769 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:08.957592 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:08.960825 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:08.961484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:09.061616 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:09.062075 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:09.062533 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lazy-loading 'fault' on Instance uuid 99a1a19c-745a-4bd6-ac50-edfee196c266 {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:17:09.115271 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-50519738-dbf0-4def-9a77-783b84c2f12c req-3d47705f-7097-4e99-a45a-b6de555c4751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48a0fde-a6e2-447e-b977-2a8d2ecca65f", "name": "network-vif-unplugged", "status": "completed", "tag": "e4baaf10-25ec-45f6-8706-8a010940d744"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:17:09.134373 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-50519738-dbf0-4def-9a77-783b84c2f12c req-3d47705f-7097-4e99-a45a-b6de555c4751 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:09.136321 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-50519738-dbf0-4def-9a77-783b84c2f12c req-3d47705f-7097-4e99-a45a-b6de555c4751 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:09.171252 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec72d8adbb84b32a74b3c85a260c6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64651a79ca496dbf2a79dba7e085ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:09.175587 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-50519738-dbf0-4def-9a77-783b84c2f12c req-3d47705f-7097-4e99-a45a-b6de555c4751 service nova] Creating event network-vif-unplugged:e4baaf10-25ec-45f6-8706-8a010940d744 for instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f on hv-cinder-84330 May 25 17:17:09.180823 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5a62d59b-f661-4325-8579-eb4fa055ffd1 tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 200 len: 1304 microversion: 2.1 time: 0.236930 May 25 17:17:09.181727 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 496/964] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:08 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 1304 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:09.195780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-50519738-dbf0-4def-9a77-783b84c2f12c req-3d47705f-7097-4e99-a45a-b6de555c4751 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085060 May 25 17:17:09.198373 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 469/965] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:17:09.453221 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-52342fc6-ec84-4346-9d9c-ec497812becc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:09.454199 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-52342fc6-ec84-4346-9d9c-ec497812becc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:09.460995 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-52342fc6-ec84-4346-9d9c-ec497812becc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:09.461593 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-52342fc6-ec84-4346-9d9c-ec497812becc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:09.462615 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-52342fc6-ec84-4346-9d9c-ec497812becc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:09.463178 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-52342fc6-ec84-4346-9d9c-ec497812becc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:09.686786 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-52342fc6-ec84-4346-9d9c-ec497812becc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:09.700126 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-52342fc6-ec84-4346-9d9c-ec497812becc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1577 microversion: 2.1 time: 0.252122 May 25 17:17:09.701567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 497/966] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:09 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:17:10.155543 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-bed16db5-1660-403a-9ead-4833ab4e7e72 req-717b70d4-2cde-4aa9-a937-00563d332edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48a0fde-a6e2-447e-b977-2a8d2ecca65f", "name": "network-vif-deleted", "tag": "e4baaf10-25ec-45f6-8706-8a010940d744"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:17:10.182331 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-bed16db5-1660-403a-9ead-4833ab4e7e72 req-717b70d4-2cde-4aa9-a937-00563d332edb service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:10.183537 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-bed16db5-1660-403a-9ead-4833ab4e7e72 req-717b70d4-2cde-4aa9-a937-00563d332edb service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:10.198215 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e133623c-336a-47b8-8028-cf978c82fdac tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:10.198827 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e133623c-336a-47b8-8028-cf978c82fdac tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] [instance: 99a1a19c-745a-4bd6-ac50-edfee196c266] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:10.215175 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e133623c-336a-47b8-8028-cf978c82fdac tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:10.215967 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-bed16db5-1660-403a-9ead-4833ab4e7e72 req-717b70d4-2cde-4aa9-a937-00563d332edb service nova] Creating event network-vif-deleted:e4baaf10-25ec-45f6-8706-8a010940d744 for instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f on hv-cinder-84330 May 25 17:17:10.222542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e133623c-336a-47b8-8028-cf978c82fdac tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:10.224096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e133623c-336a-47b8-8028-cf978c82fdac tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:10.227422 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-bed16db5-1660-403a-9ead-4833ab4e7e72 req-717b70d4-2cde-4aa9-a937-00563d332edb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076145 May 25 17:17:10.228238 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e133623c-336a-47b8-8028-cf978c82fdac tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:10.230905 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 470/967] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:17:10.256936 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-e133623c-336a-47b8-8028-cf978c82fdac tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] HTTP exception thrown: Instance 99a1a19c-745a-4bd6-ac50-edfee196c266 could not be found. May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e133623c-336a-47b8-8028-cf978c82fdac tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Request method failure captured: May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 HTTP/1.1 May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmR-kX70yxwCvbufKZPdfXL29XApOQjw1byi5mclvROcmtf86rkZfVt-0t-BTxt3gwEYKjw1k4wnoaPSOUBfZCD74hXnlHmGotuhOq0UE6au76d1DV2LM4wp3RxWkzVksATjor5e4j19ouV-ruSyOC-OblW11Q0q3VqxIf0TLsvReRI May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: cb64651a79ca496dbf2a79dba7e085ff May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-VolumesNegativeTest-411841985 May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:17:10.258686 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_cb64651a79ca496dbf2a79dba7e085ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/cb64651a79ca496dbf2a79dba7e085ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/cb64651a79ca496dbf2a79dba7e085ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/cb64651a79ca496dbf2a79dba7e085ff"}]}] May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-VolumesNegativeTest-411841985 May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: cb64651a79ca496dbf2a79dba7e085ff May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-VolumesNegativeTest-411841985 May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-VolumesNegativeTest-411841985-project May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 1ec72d8adbb84b32a74b3c85a260c6a2 May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-VolumesNegativeTest-411841985-project May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 99a1a19c-745a-4bd6-ac50-edfee196c266 could not be found. May 25 17:17:10.260489 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '99a1a19c-745a-4bd6-ac50-edfee196c266'} May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99a1a19c-745a-4bd6-ac50-edfee196c266 could not be found. May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:17:10.261501 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99a1a19c-745a-4bd6-ac50-edfee196c266 could not be found. May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99a1a19c-745a-4bd6-ac50-edfee196c266 could not be found. May 25 17:17:10.263899 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:17:10.266657 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e133623c-336a-47b8-8028-cf978c82fdac tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] Returning 404 to user: Instance 99a1a19c-745a-4bd6-ac50-edfee196c266 could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:17:10.267745 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e133623c-336a-47b8-8028-cf978c82fdac tempest-VolumesNegativeTest-411841985 tempest-VolumesNegativeTest-411841985-project] 10.222.0.31 "GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266" status: 404 len: 111 microversion: 2.1 time: 0.073482 May 25 17:17:10.269801 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 498/968] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:10 2022] GET /compute/v2.1/servers/99a1a19c-745a-4bd6-ac50-edfee196c266 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 17:17:10.718945 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:10.719645 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:10.727787 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:10.728461 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:10.729747 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:10.730361 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:10.765744 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:10.766437 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:10.767040 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lazy-loading 'fault' on Instance uuid d48a0fde-a6e2-447e-b977-2a8d2ecca65f {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:17:10.819306 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:10.827748 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a33f3d05-1ed3-4633-8358-fc32b85c826a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 200 len: 1230 microversion: 2.1 time: 0.112772 May 25 17:17:10.829026 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 471/969] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:10 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:11.845484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e94966fb-6a6a-43ab-8e6d-118946a1d580 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:11.846094 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e94966fb-6a6a-43ab-8e6d-118946a1d580 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:11.853651 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e94966fb-6a6a-43ab-8e6d-118946a1d580 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:11.854190 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e94966fb-6a6a-43ab-8e6d-118946a1d580 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:11.855045 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e94966fb-6a6a-43ab-8e6d-118946a1d580 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:11.855554 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e94966fb-6a6a-43ab-8e6d-118946a1d580 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:11.870300 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-e94966fb-6a6a-43ab-8e6d-118946a1d580 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] HTTP exception thrown: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e94966fb-6a6a-43ab-8e6d-118946a1d580 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Request method failure captured: May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f HTTP/1.1 May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmPfn8BR2T9QdescIgB-5jTN7-JI3-TIaVot41mhBltSCgDK9EEeMaO-lcjl7cKxGGJngRCoww2Q5nDriZcYuq-Ewrm_UP7yxLvLM5Wpaoz5XaN9OiSVffrtGDK3yKMXoCDXOgBD0FSHIeqn7QUpDp2FaEUo_ur5Xy6l3irwHcQSyvs May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: df9bc8d103cf40e1b8d984f1947e7c5d May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-TestVolumeBootPattern-114242761 May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:17:11.871845 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/df9bc8d103cf40e1b8d984f1947e7c5d"}]}] May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-TestVolumeBootPattern-114242761 May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: df9bc8d103cf40e1b8d984f1947e7c5d May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-TestVolumeBootPattern-114242761 May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-TestVolumeBootPattern-114242761-project May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 47642301725e4023aba48b2a3a64d5b9 May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-TestVolumeBootPattern-114242761-project May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:17:11.873326 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': 'd48a0fde-a6e2-447e-b977-2a8d2ecca65f'} May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:17:11.874163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:17:11.875658 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:17:11.877015 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e94966fb-6a6a-43ab-8e6d-118946a1d580 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Returning 404 to user: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:17:11.877015 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e94966fb-6a6a-43ab-8e6d-118946a1d580 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 404 len: 111 microversion: 2.1 time: 0.031712 May 25 17:17:11.877015 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 499/970] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:11 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:17:11.979446 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1895266811", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-500528931", "security_groups": [{"name": "tempest-secgroup-smoke-215202645"}], "block_device_mapping_v2": [{"uuid": "9e4c7db4-ac13-40e4-a58c-02baca75239c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f83d3faf-d265-477f-8499-04e56bb140df"}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:17:12.105732 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] validate_networks() for [('f83d3faf-d265-477f-8499-04e56bb140df', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:17:12.840361 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:17:12.840814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:17:12.841284 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:17:12.841868 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:17:12.842278 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:17:12.854335 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:12.854335 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:12.854335 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:12.854335 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:12.872406 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Getting quotas for project df9bc8d103cf40e1b8d984f1947e7c5d. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:17:12.877268 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Getting quotas for user 47642301725e4023aba48b2a3a64d5b9 and project df9bc8d103cf40e1b8d984f1947e7c5d. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:17:12.940817 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:17:12.943043 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e4c7db4-ac13-40e4-a58c-02baca75239c',volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:17:13.081520 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-755ff201-9a5a-4c46-8091-e11bd3dae44b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.106129 May 25 17:17:13.088025 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 472/971] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:17:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:17:13.093946 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8d38545c-8654-4671-9f39-0453f7d9c983 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:13.094570 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8d38545c-8654-4671-9f39-0453f7d9c983 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:13.166172 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8d38545c-8654-4671-9f39-0453f7d9c983 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:13.175465 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8d38545c-8654-4671-9f39-0453f7d9c983 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1094 microversion: 2.1 time: 0.085431 May 25 17:17:13.176300 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 500/972] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:13 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:17:14.194001 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a8266b72-3be6-4994-a3aa-13d62a532f88 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:14.199714 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a8266b72-3be6-4994-a3aa-13d62a532f88 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:14.206187 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a8266b72-3be6-4994-a3aa-13d62a532f88 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:14.206648 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a8266b72-3be6-4994-a3aa-13d62a532f88 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:14.207999 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a8266b72-3be6-4994-a3aa-13d62a532f88 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:14.208653 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a8266b72-3be6-4994-a3aa-13d62a532f88 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:14.282669 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a8266b72-3be6-4994-a3aa-13d62a532f88 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:14.296363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a8266b72-3be6-4994-a3aa-13d62a532f88 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1192 microversion: 2.1 time: 0.106374 May 25 17:17:14.297616 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 473/973] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:14 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:15.323983 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-469afdef-5a5d-4780-ad4a-ea74a5c6180e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:15.325404 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-469afdef-5a5d-4780-ad4a-ea74a5c6180e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:15.346435 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-469afdef-5a5d-4780-ad4a-ea74a5c6180e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:15.350947 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-469afdef-5a5d-4780-ad4a-ea74a5c6180e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:15.354317 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-469afdef-5a5d-4780-ad4a-ea74a5c6180e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:15.355106 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-469afdef-5a5d-4780-ad4a-ea74a5c6180e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:15.593724 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-469afdef-5a5d-4780-ad4a-ea74a5c6180e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:15.611794 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-469afdef-5a5d-4780-ad4a-ea74a5c6180e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.293238 May 25 17:17:15.626019 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 501/974] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:15 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:16.015363 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-369beab2-c821-4483-b88a-65c1befc3bac req-df7fdc3e-4f7c-40fd-9cc8-beba76cb74f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ac9494-0f69-4730-bfa8-16654e1eff8c", "tag": "2a0150b3-ed16-4d05-8467-4a200d9130b6"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:17:16.038854 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-369beab2-c821-4483-b88a-65c1befc3bac req-df7fdc3e-4f7c-40fd-9cc8-beba76cb74f5 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:16.039466 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-369beab2-c821-4483-b88a-65c1befc3bac req-df7fdc3e-4f7c-40fd-9cc8-beba76cb74f5 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:16.054142 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-369beab2-c821-4483-b88a-65c1befc3bac req-df7fdc3e-4f7c-40fd-9cc8-beba76cb74f5 service nova] Creating event network-changed:2a0150b3-ed16-4d05-8467-4a200d9130b6 for instance 51ac9494-0f69-4730-bfa8-16654e1eff8c on hv-cinder-84330 May 25 17:17:16.069649 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-369beab2-c821-4483-b88a-65c1befc3bac req-df7fdc3e-4f7c-40fd-9cc8-beba76cb74f5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059458 May 25 17:17:16.070436 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 474/975] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:17:16.632377 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b70156d9-9498-4b85-abf1-83c0e85b9dca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:16.633195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b70156d9-9498-4b85-abf1-83c0e85b9dca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:16.641641 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b70156d9-9498-4b85-abf1-83c0e85b9dca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:16.642102 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b70156d9-9498-4b85-abf1-83c0e85b9dca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:16.642880 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b70156d9-9498-4b85-abf1-83c0e85b9dca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:16.643320 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b70156d9-9498-4b85-abf1-83c0e85b9dca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:16.870475 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b70156d9-9498-4b85-abf1-83c0e85b9dca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:16.882163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b70156d9-9498-4b85-abf1-83c0e85b9dca tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.252334 May 25 17:17:16.883487 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 502/976] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:16 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:17.905370 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c0bc4388-8f52-4ebd-9a01-b752efb13e13 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:17.908748 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c0bc4388-8f52-4ebd-9a01-b752efb13e13 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:17.922352 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0bc4388-8f52-4ebd-9a01-b752efb13e13 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:17.923739 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0bc4388-8f52-4ebd-9a01-b752efb13e13 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:17.924759 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0bc4388-8f52-4ebd-9a01-b752efb13e13 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:17.925427 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0bc4388-8f52-4ebd-9a01-b752efb13e13 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:18.260188 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c0bc4388-8f52-4ebd-9a01-b752efb13e13 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:18.274266 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c0bc4388-8f52-4ebd-9a01-b752efb13e13 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.376115 May 25 17:17:18.286862 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 475/977] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:17 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:19.292080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-2ca97ddb-a987-404e-81d2-43d0b26dd313 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:19.292973 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-2ca97ddb-a987-404e-81d2-43d0b26dd313 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:19.300456 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2ca97ddb-a987-404e-81d2-43d0b26dd313 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:19.301079 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2ca97ddb-a987-404e-81d2-43d0b26dd313 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:19.302528 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2ca97ddb-a987-404e-81d2-43d0b26dd313 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:19.303276 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-2ca97ddb-a987-404e-81d2-43d0b26dd313 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:19.652579 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-2ca97ddb-a987-404e-81d2-43d0b26dd313 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:19.662862 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-2ca97ddb-a987-404e-81d2-43d0b26dd313 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.374502 May 25 17:17:19.668223 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 503/978] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:19 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:20.686232 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b66ce1ec-afd3-46fd-bcba-c96489fadd86 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:20.688258 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b66ce1ec-afd3-46fd-bcba-c96489fadd86 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:20.696005 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b66ce1ec-afd3-46fd-bcba-c96489fadd86 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:20.696539 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b66ce1ec-afd3-46fd-bcba-c96489fadd86 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:20.697432 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b66ce1ec-afd3-46fd-bcba-c96489fadd86 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:20.698086 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b66ce1ec-afd3-46fd-bcba-c96489fadd86 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:20.907580 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b66ce1ec-afd3-46fd-bcba-c96489fadd86 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:20.918353 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b66ce1ec-afd3-46fd-bcba-c96489fadd86 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.238016 May 25 17:17:20.920432 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 476/979] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:20 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:21.939449 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5aea31c3-0d20-444e-a965-8ce4bf72ea4a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:21.939998 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5aea31c3-0d20-444e-a965-8ce4bf72ea4a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:21.946795 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5aea31c3-0d20-444e-a965-8ce4bf72ea4a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:21.947261 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5aea31c3-0d20-444e-a965-8ce4bf72ea4a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:21.948045 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5aea31c3-0d20-444e-a965-8ce4bf72ea4a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:21.948491 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5aea31c3-0d20-444e-a965-8ce4bf72ea4a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:22.101595 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5aea31c3-0d20-444e-a965-8ce4bf72ea4a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:22.109723 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5aea31c3-0d20-444e-a965-8ce4bf72ea4a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.176762 May 25 17:17:22.110612 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 504/980] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:21 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:23.128334 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0349ba29-519c-4749-a581-c02e0546529a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:23.129036 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0349ba29-519c-4749-a581-c02e0546529a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:23.131575 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:23.132225 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:23.145023 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0349ba29-519c-4749-a581-c02e0546529a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:23.145793 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0349ba29-519c-4749-a581-c02e0546529a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:23.146663 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0349ba29-519c-4749-a581-c02e0546529a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:23.147103 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0349ba29-519c-4749-a581-c02e0546529a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:23.440260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0349ba29-519c-4749-a581-c02e0546529a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:23.448320 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0349ba29-519c-4749-a581-c02e0546529a tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.324714 May 25 17:17:23.458581 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 477/981] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:23 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:24.468368 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3aac44b3-57ff-4a65-b30f-5ed293680f1f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:24.468939 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3aac44b3-57ff-4a65-b30f-5ed293680f1f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:24.473498 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:24.490740 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3aac44b3-57ff-4a65-b30f-5ed293680f1f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:24.494627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3aac44b3-57ff-4a65-b30f-5ed293680f1f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:24.496953 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3aac44b3-57ff-4a65-b30f-5ed293680f1f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:24.499850 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3aac44b3-57ff-4a65-b30f-5ed293680f1f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:24.748461 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3aac44b3-57ff-4a65-b30f-5ed293680f1f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:24.758706 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3aac44b3-57ff-4a65-b30f-5ed293680f1f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.295915 May 25 17:17:24.759933 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 505/982] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:24 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:25.776157 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-31844d97-6cac-4650-a56c-b71d3ccdde07 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:25.777418 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-31844d97-6cac-4650-a56c-b71d3ccdde07 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:25.793289 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-31844d97-6cac-4650-a56c-b71d3ccdde07 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:25.796136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-31844d97-6cac-4650-a56c-b71d3ccdde07 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:25.798847 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-31844d97-6cac-4650-a56c-b71d3ccdde07 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:25.800244 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-31844d97-6cac-4650-a56c-b71d3ccdde07 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:26.149981 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-31844d97-6cac-4650-a56c-b71d3ccdde07 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:26.158279 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-31844d97-6cac-4650-a56c-b71d3ccdde07 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.386261 May 25 17:17:26.158858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 478/983] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:25 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:27.194164 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-91d4c69a-406a-4cc1-9d4b-d7fa7b8181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:27.203357 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-91d4c69a-406a-4cc1-9d4b-d7fa7b8181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:27.251769 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-91d4c69a-406a-4cc1-9d4b-d7fa7b8181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:27.256097 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-91d4c69a-406a-4cc1-9d4b-d7fa7b8181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:27.258100 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-91d4c69a-406a-4cc1-9d4b-d7fa7b8181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:27.259903 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-91d4c69a-406a-4cc1-9d4b-d7fa7b8181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:27.651766 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-91d4c69a-406a-4cc1-9d4b-d7fa7b8181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:27.661534 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-91d4c69a-406a-4cc1-9d4b-d7fa7b8181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.477587 May 25 17:17:27.664946 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 506/984] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:27 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:27.724007 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-d9f9064e-1068-4557-8dea-9359c2db924b req-f36d8035-bdd2-415c-b585-dd6003968fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ac9494-0f69-4730-bfa8-16654e1eff8c", "name": "network-vif-plugged", "status": "completed", "tag": "2a0150b3-ed16-4d05-8467-4a200d9130b6"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:17:27.743370 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-d9f9064e-1068-4557-8dea-9359c2db924b req-f36d8035-bdd2-415c-b585-dd6003968fa4 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:27.743823 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-d9f9064e-1068-4557-8dea-9359c2db924b req-f36d8035-bdd2-415c-b585-dd6003968fa4 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:27.769753 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-d9f9064e-1068-4557-8dea-9359c2db924b req-f36d8035-bdd2-415c-b585-dd6003968fa4 service nova] Creating event network-vif-plugged:2a0150b3-ed16-4d05-8467-4a200d9130b6 for instance 51ac9494-0f69-4730-bfa8-16654e1eff8c on hv-cinder-84330 May 25 17:17:27.777347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-d9f9064e-1068-4557-8dea-9359c2db924b req-f36d8035-bdd2-415c-b585-dd6003968fa4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058104 May 25 17:17:27.778919 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 479/985] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:17:28.686599 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3c1c6e68-3357-41e3-8ec7-7bf061eafbc4 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:28.688363 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3c1c6e68-3357-41e3-8ec7-7bf061eafbc4 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:28.698500 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c1c6e68-3357-41e3-8ec7-7bf061eafbc4 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:28.698960 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c1c6e68-3357-41e3-8ec7-7bf061eafbc4 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:28.699748 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c1c6e68-3357-41e3-8ec7-7bf061eafbc4 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:28.701457 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3c1c6e68-3357-41e3-8ec7-7bf061eafbc4 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:28.922661 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3c1c6e68-3357-41e3-8ec7-7bf061eafbc4 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:28.933227 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3c1c6e68-3357-41e3-8ec7-7bf061eafbc4 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1265 microversion: 2.1 time: 0.253634 May 25 17:17:28.934610 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 507/986] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:28 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:29.953166 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2ae6cc49-42b4-41c7-b98b-8aa30750baac tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:29.954563 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2ae6cc49-42b4-41c7-b98b-8aa30750baac tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:29.971053 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2ae6cc49-42b4-41c7-b98b-8aa30750baac tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:29.971526 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2ae6cc49-42b4-41c7-b98b-8aa30750baac tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:29.972431 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2ae6cc49-42b4-41c7-b98b-8aa30750baac tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:29.973774 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2ae6cc49-42b4-41c7-b98b-8aa30750baac tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:30.207891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2ae6cc49-42b4-41c7-b98b-8aa30750baac tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:30.221849 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2ae6cc49-42b4-41c7-b98b-8aa30750baac tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1452 microversion: 2.1 time: 0.272946 May 25 17:17:30.252409 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-857d8287-333b-4dc5-92b3-f42ea665cf2b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:30.272272 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-857d8287-333b-4dc5-92b3-f42ea665cf2b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:30.283265 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 480/987] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:29 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1452 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:30.295232 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-857d8287-333b-4dc5-92b3-f42ea665cf2b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:30.295911 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-857d8287-333b-4dc5-92b3-f42ea665cf2b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:30.296918 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-857d8287-333b-4dc5-92b3-f42ea665cf2b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:30.297596 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-857d8287-333b-4dc5-92b3-f42ea665cf2b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:30.537877 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-857d8287-333b-4dc5-92b3-f42ea665cf2b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:30.549047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-857d8287-333b-4dc5-92b3-f42ea665cf2b tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1452 microversion: 2.1 time: 0.300122 May 25 17:17:30.551192 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 508/988] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:30 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1452 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:33.219189 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-92ce97a7-83ce-4e2d-8589-209aa1007e74 req-7b91a843-fbf7-4928-b174-cc17f99935eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ac9494-0f69-4730-bfa8-16654e1eff8c", "tag": "2a0150b3-ed16-4d05-8467-4a200d9130b6"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:17:33.229612 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-92ce97a7-83ce-4e2d-8589-209aa1007e74 req-7b91a843-fbf7-4928-b174-cc17f99935eb service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:33.230181 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-92ce97a7-83ce-4e2d-8589-209aa1007e74 req-7b91a843-fbf7-4928-b174-cc17f99935eb service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:33.251200 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-92ce97a7-83ce-4e2d-8589-209aa1007e74 req-7b91a843-fbf7-4928-b174-cc17f99935eb service nova] Creating event network-changed:2a0150b3-ed16-4d05-8467-4a200d9130b6 for instance 51ac9494-0f69-4730-bfa8-16654e1eff8c on hv-cinder-84330 May 25 17:17:33.258511 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-92ce97a7-83ce-4e2d-8589-209aa1007e74 req-7b91a843-fbf7-4928-b174-cc17f99935eb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042844 May 25 17:17:33.262497 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 481/989] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:17:40.444346 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-19b2f9f3-2cfc-4297-9786-15f47c70a605 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Action: 'create', calling method: .version_select at 0x7f3d4e1d7af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-544398757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVUDtBuGKkA2JvG6PSUn3I6Ad896ikqSpxZuFEi+2gf/sGgIzP4GWUnEDYyHwGKXijsX/cB3K8A4MgxyjBk5R8W9OrQZ6MB4Zaw3ODqYH55/vvrLBYKH/vvuIBPg8nJqQ=="}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:17:40.448370 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=43 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:40.460293 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-19b2f9f3-2cfc-4297-9786-15f47c70a605 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Getting quotas for project 195f7502e12548c5820b9b176a98b349. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:17:40.464242 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.quota [None req-19b2f9f3-2cfc-4297-9786-15f47c70a605 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Getting quotas for user 03703b61e1d3442aaf8346abb5159725 and project 195f7502e12548c5820b9b176a98b349. Resources: {'key_pairs'} {{(pid=117695) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:17:40.486723 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-19b2f9f3-2cfc-4297-9786-15f47c70a605 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046911 May 25 17:17:40.487469 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 509/990] 10.222.0.31 () {60 vars in 1158 bytes} [Wed May 25 17:17:40 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:17:40.587348 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2505890", "imageRef": "c6f28bd2-1f33-42fe-864b-1eca7823ae8f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-544398757", "networks": [{"uuid": "e6f08fc4-b293-432c-a878-9fdf1df40d71"}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:17:40.594565 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:40.644957 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] validate_networks() for [('e6f08fc4-b293-432c-a878-9fdf1df40d71', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:17:41.027465 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:17:41.027896 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:17:41.028383 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:17:41.028830 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:17:41.029250 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:17:41.038272 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:41.038727 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:41.039533 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:41.039979 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:41.046650 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:41.059639 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Getting quotas for project 195f7502e12548c5820b9b176a98b349. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:17:41.063643 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Getting quotas for user 03703b61e1d3442aaf8346abb5159725 and project 195f7502e12548c5820b9b176a98b349. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:17:41.075379 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:17:41.077686 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6f28bd2-1f33-42fe-864b-1eca7823ae8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:17:41.127895 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a97ed527-e1c7-4306-902c-975bfa797fca tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544647 May 25 17:17:41.134280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 482/991] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:17:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 17:17:41.136439 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=99 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:41.151424 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-bf835f65-1075-4572-af9e-d0642d73c98f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:41.152078 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-bf835f65-1075-4572-af9e-d0642d73c98f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:41.214426 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-bf835f65-1075-4572-af9e-d0642d73c98f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:41.221566 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-bf835f65-1075-4572-af9e-d0642d73c98f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1255 microversion: 2.1 time: 0.085778 May 25 17:17:41.223090 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 510/992] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:41 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1255 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:42.241370 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ed7213b-8a4c-4eda-911d-29f5bae33092 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:42.242759 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0ed7213b-8a4c-4eda-911d-29f5bae33092 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:42.250926 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ed7213b-8a4c-4eda-911d-29f5bae33092 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:42.251718 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ed7213b-8a4c-4eda-911d-29f5bae33092 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:42.252646 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ed7213b-8a4c-4eda-911d-29f5bae33092 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:42.253906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ed7213b-8a4c-4eda-911d-29f5bae33092 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:42.340148 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0ed7213b-8a4c-4eda-911d-29f5bae33092 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:42.348261 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0ed7213b-8a4c-4eda-911d-29f5bae33092 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1313 microversion: 2.1 time: 0.112490 May 25 17:17:42.357958 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 483/993] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:42 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1313 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:17:43.369525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-de5610eb-1e7d-447d-9752-e0bd78b1a670 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:43.372068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-de5610eb-1e7d-447d-9752-e0bd78b1a670 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:43.388245 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-de5610eb-1e7d-447d-9752-e0bd78b1a670 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:43.389190 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-de5610eb-1e7d-447d-9752-e0bd78b1a670 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:43.391539 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-de5610eb-1e7d-447d-9752-e0bd78b1a670 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:43.392226 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-de5610eb-1e7d-447d-9752-e0bd78b1a670 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:43.531770 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-de5610eb-1e7d-447d-9752-e0bd78b1a670 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:43.540316 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-de5610eb-1e7d-447d-9752-e0bd78b1a670 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.178098 May 25 17:17:43.540924 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 511/994] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:43 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:44.559984 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-390a7f0d-102a-4f4c-8d4e-1fce924701fe tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:44.560647 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-390a7f0d-102a-4f4c-8d4e-1fce924701fe tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:44.567276 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-390a7f0d-102a-4f4c-8d4e-1fce924701fe tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:44.568041 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-390a7f0d-102a-4f4c-8d4e-1fce924701fe tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:44.569331 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-390a7f0d-102a-4f4c-8d4e-1fce924701fe tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:44.569983 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-390a7f0d-102a-4f4c-8d4e-1fce924701fe tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:44.708873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-390a7f0d-102a-4f4c-8d4e-1fce924701fe tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:44.716375 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-390a7f0d-102a-4f4c-8d4e-1fce924701fe tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.160668 May 25 17:17:44.717003 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 484/995] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:44 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:45.735445 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e02847b5-0d1c-4702-8ad9-9cc439a30282 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:45.736514 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e02847b5-0d1c-4702-8ad9-9cc439a30282 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:45.745497 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e02847b5-0d1c-4702-8ad9-9cc439a30282 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:45.746499 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e02847b5-0d1c-4702-8ad9-9cc439a30282 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:45.747463 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e02847b5-0d1c-4702-8ad9-9cc439a30282 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:45.748406 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e02847b5-0d1c-4702-8ad9-9cc439a30282 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:45.913869 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e02847b5-0d1c-4702-8ad9-9cc439a30282 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:45.921636 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e02847b5-0d1c-4702-8ad9-9cc439a30282 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.191101 May 25 17:17:45.932055 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 512/996] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:45 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:46.939968 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b3bab647-052c-435f-8b4a-d9c23f43065c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:46.941451 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b3bab647-052c-435f-8b4a-d9c23f43065c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:46.948809 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b3bab647-052c-435f-8b4a-d9c23f43065c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:46.949661 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b3bab647-052c-435f-8b4a-d9c23f43065c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:46.950438 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b3bab647-052c-435f-8b4a-d9c23f43065c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:46.951030 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b3bab647-052c-435f-8b4a-d9c23f43065c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:47.108338 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b3bab647-052c-435f-8b4a-d9c23f43065c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:47.117014 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b3bab647-052c-435f-8b4a-d9c23f43065c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.180874 May 25 17:17:47.117595 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 485/997] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:46 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:48.135676 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b2475202-5c4a-4be9-9671-ed289ab8ee76 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:48.136285 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b2475202-5c4a-4be9-9671-ed289ab8ee76 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:48.147351 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b2475202-5c4a-4be9-9671-ed289ab8ee76 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:48.148053 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b2475202-5c4a-4be9-9671-ed289ab8ee76 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:48.148927 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b2475202-5c4a-4be9-9671-ed289ab8ee76 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:48.149557 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b2475202-5c4a-4be9-9671-ed289ab8ee76 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:48.297512 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-b2475202-5c4a-4be9-9671-ed289ab8ee76 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:48.310227 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b2475202-5c4a-4be9-9671-ed289ab8ee76 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.178968 May 25 17:17:48.311355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 513/998] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:48 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:49.333689 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-29cbdbb7-53b7-4d52-8995-310c21212d7c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:49.338255 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-29cbdbb7-53b7-4d52-8995-310c21212d7c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:49.357925 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-29cbdbb7-53b7-4d52-8995-310c21212d7c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:49.358403 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-29cbdbb7-53b7-4d52-8995-310c21212d7c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:49.359417 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-29cbdbb7-53b7-4d52-8995-310c21212d7c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:49.359864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-29cbdbb7-53b7-4d52-8995-310c21212d7c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:49.514124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-29cbdbb7-53b7-4d52-8995-310c21212d7c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:49.522864 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-29cbdbb7-53b7-4d52-8995-310c21212d7c tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.197752 May 25 17:17:49.523451 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 486/999] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:49 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:50.540382 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-040b80ed-00e6-45b2-9d20-abbfe277177d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:50.541353 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-040b80ed-00e6-45b2-9d20-abbfe277177d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:50.548309 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-040b80ed-00e6-45b2-9d20-abbfe277177d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:50.548804 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-040b80ed-00e6-45b2-9d20-abbfe277177d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:50.549584 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-040b80ed-00e6-45b2-9d20-abbfe277177d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:50.550088 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-040b80ed-00e6-45b2-9d20-abbfe277177d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:50.696643 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-040b80ed-00e6-45b2-9d20-abbfe277177d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:50.704143 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-040b80ed-00e6-45b2-9d20-abbfe277177d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.167728 May 25 17:17:50.704776 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 514/1000] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:50 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:51.721773 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-39bfc20b-2835-4c3d-bd50-b8bbdedd4bc0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:51.723390 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-39bfc20b-2835-4c3d-bd50-b8bbdedd4bc0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:51.726008 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:51.726742 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:51.732706 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-39bfc20b-2835-4c3d-bd50-b8bbdedd4bc0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:51.733164 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-39bfc20b-2835-4c3d-bd50-b8bbdedd4bc0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:51.733925 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-39bfc20b-2835-4c3d-bd50-b8bbdedd4bc0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:51.734362 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-39bfc20b-2835-4c3d-bd50-b8bbdedd4bc0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:51.861883 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-39bfc20b-2835-4c3d-bd50-b8bbdedd4bc0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:51.869280 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-39bfc20b-2835-4c3d-bd50-b8bbdedd4bc0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.151479 May 25 17:17:51.869841 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 487/1001] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:51 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:52.887009 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f806bd7a-04b4-43bd-a2a1-92f4e4188262 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:52.887628 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f806bd7a-04b4-43bd-a2a1-92f4e4188262 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:52.889817 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=6 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:52.896556 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f806bd7a-04b4-43bd-a2a1-92f4e4188262 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:52.896973 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f806bd7a-04b4-43bd-a2a1-92f4e4188262 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:52.897751 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f806bd7a-04b4-43bd-a2a1-92f4e4188262 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:52.898196 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f806bd7a-04b4-43bd-a2a1-92f4e4188262 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:53.036836 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f806bd7a-04b4-43bd-a2a1-92f4e4188262 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:53.044339 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f806bd7a-04b4-43bd-a2a1-92f4e4188262 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.161981 May 25 17:17:53.044999 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 515/1002] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:52 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:53.651527 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-4de8ad53-72b8-4297-9493-4488e3dfefbf req-d2d1715a-11ec-4f59-9e0b-cabf37d06620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04921db8-8f39-49f2-b92b-0f01b6dcf48e", "tag": "5c08472c-6b26-4979-9138-9b2053d5447f"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:17:53.653905 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:17:53.654058 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Wed May 25 17:17:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:17:53.672216 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4de8ad53-72b8-4297-9493-4488e3dfefbf req-d2d1715a-11ec-4f59-9e0b-cabf37d06620 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:53.673033 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4de8ad53-72b8-4297-9493-4488e3dfefbf req-d2d1715a-11ec-4f59-9e0b-cabf37d06620 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:53.706809 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-4de8ad53-72b8-4297-9493-4488e3dfefbf req-d2d1715a-11ec-4f59-9e0b-cabf37d06620 service nova] Creating event network-changed:5c08472c-6b26-4979-9138-9b2053d5447f for instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e on hv-cinder-84330 May 25 17:17:53.712364 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-4de8ad53-72b8-4297-9493-4488e3dfefbf req-d2d1715a-11ec-4f59-9e0b-cabf37d06620 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064876 May 25 17:17:53.713419 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 488/1003] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:17:54.062114 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4a2b7849-00fd-4d37-9267-c500c97e51b8 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:54.062769 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4a2b7849-00fd-4d37-9267-c500c97e51b8 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:54.069553 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4a2b7849-00fd-4d37-9267-c500c97e51b8 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:54.070016 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4a2b7849-00fd-4d37-9267-c500c97e51b8 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:54.070801 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4a2b7849-00fd-4d37-9267-c500c97e51b8 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:54.071245 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4a2b7849-00fd-4d37-9267-c500c97e51b8 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:54.205297 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4a2b7849-00fd-4d37-9267-c500c97e51b8 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:54.214564 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4a2b7849-00fd-4d37-9267-c500c97e51b8 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.156600 May 25 17:17:54.215234 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 516/1004] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:54 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:17:55.233799 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-53f9293e-a854-40a7-86a8-06a87f421040 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:55.234512 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-53f9293e-a854-40a7-86a8-06a87f421040 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:55.241954 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53f9293e-a854-40a7-86a8-06a87f421040 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:55.242409 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53f9293e-a854-40a7-86a8-06a87f421040 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:55.243180 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53f9293e-a854-40a7-86a8-06a87f421040 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:55.243623 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53f9293e-a854-40a7-86a8-06a87f421040 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:55.373106 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-53f9293e-a854-40a7-86a8-06a87f421040 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:55.380713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-53f9293e-a854-40a7-86a8-06a87f421040 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.151373 May 25 17:17:55.381275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 489/1005] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:55 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:56.397415 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-02e7dbd5-0393-4ce0-a67d-5a716ba793ef tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:56.398029 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-02e7dbd5-0393-4ce0-a67d-5a716ba793ef tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:56.404493 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-02e7dbd5-0393-4ce0-a67d-5a716ba793ef tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:56.404976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-02e7dbd5-0393-4ce0-a67d-5a716ba793ef tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:56.405775 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-02e7dbd5-0393-4ce0-a67d-5a716ba793ef tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:56.406218 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-02e7dbd5-0393-4ce0-a67d-5a716ba793ef tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:56.534047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-02e7dbd5-0393-4ce0-a67d-5a716ba793ef tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:56.541728 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-02e7dbd5-0393-4ce0-a67d-5a716ba793ef tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.148209 May 25 17:17:56.542287 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 517/1006] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:56 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:57.560627 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c90a4ad6-1f3b-40b5-a49b-d5431f3cfeba tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:57.561293 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c90a4ad6-1f3b-40b5-a49b-d5431f3cfeba tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:57.568468 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c90a4ad6-1f3b-40b5-a49b-d5431f3cfeba tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:57.569141 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c90a4ad6-1f3b-40b5-a49b-d5431f3cfeba tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:57.569930 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c90a4ad6-1f3b-40b5-a49b-d5431f3cfeba tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:57.570372 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c90a4ad6-1f3b-40b5-a49b-d5431f3cfeba tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:57.790524 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c90a4ad6-1f3b-40b5-a49b-d5431f3cfeba tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:57.799058 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c90a4ad6-1f3b-40b5-a49b-d5431f3cfeba tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.242440 May 25 17:17:57.799704 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 490/1007] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:57 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:17:58.824825 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f71d63c2-be5d-49a2-8e4d-5a7fb010d201 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:17:58.825332 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f71d63c2-be5d-49a2-8e4d-5a7fb010d201 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:17:58.835520 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f71d63c2-be5d-49a2-8e4d-5a7fb010d201 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:58.835979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f71d63c2-be5d-49a2-8e4d-5a7fb010d201 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:58.836796 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f71d63c2-be5d-49a2-8e4d-5a7fb010d201 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:17:58.837236 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f71d63c2-be5d-49a2-8e4d-5a7fb010d201 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:17:58.990911 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f71d63c2-be5d-49a2-8e4d-5a7fb010d201 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:17:58.998370 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f71d63c2-be5d-49a2-8e4d-5a7fb010d201 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.185659 May 25 17:17:58.998940 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 518/1008] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:17:58 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:00.017591 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0adcc19a-eaae-4062-aea6-7e7490c412df tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:00.018209 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0adcc19a-eaae-4062-aea6-7e7490c412df tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:00.025210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0adcc19a-eaae-4062-aea6-7e7490c412df tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:00.025659 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0adcc19a-eaae-4062-aea6-7e7490c412df tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:00.026473 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0adcc19a-eaae-4062-aea6-7e7490c412df tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:00.026886 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0adcc19a-eaae-4062-aea6-7e7490c412df tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:00.162865 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0adcc19a-eaae-4062-aea6-7e7490c412df tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:00.170330 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0adcc19a-eaae-4062-aea6-7e7490c412df tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.158823 May 25 17:18:00.170896 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 491/1009] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:00 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:18:01.188084 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-6a01ff32-04b6-4001-9d54-9f4f3d42fc13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:01.188747 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-6a01ff32-04b6-4001-9d54-9f4f3d42fc13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:01.197745 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6a01ff32-04b6-4001-9d54-9f4f3d42fc13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:01.198198 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6a01ff32-04b6-4001-9d54-9f4f3d42fc13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:01.198985 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6a01ff32-04b6-4001-9d54-9f4f3d42fc13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:01.199424 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-6a01ff32-04b6-4001-9d54-9f4f3d42fc13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:01.242080 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-6793ba86-a1b2-4c57-8f22-0b60e00992d8 req-80bc28b4-0d63-4193-997a-453c74de40db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04921db8-8f39-49f2-b92b-0f01b6dcf48e", "name": "network-vif-plugged", "status": "completed", "tag": "5c08472c-6b26-4979-9138-9b2053d5447f"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:18:01.252160 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6793ba86-a1b2-4c57-8f22-0b60e00992d8 req-80bc28b4-0d63-4193-997a-453c74de40db service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:01.253269 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6793ba86-a1b2-4c57-8f22-0b60e00992d8 req-80bc28b4-0d63-4193-997a-453c74de40db service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:01.267357 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-6793ba86-a1b2-4c57-8f22-0b60e00992d8 req-80bc28b4-0d63-4193-997a-453c74de40db service nova] Creating event network-vif-plugged:5c08472c-6b26-4979-9138-9b2053d5447f for instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e on hv-cinder-84330 May 25 17:18:01.272968 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-6793ba86-a1b2-4c57-8f22-0b60e00992d8 req-80bc28b4-0d63-4193-997a-453c74de40db service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035789 May 25 17:18:01.273944 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 492/1010] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:18:01.339039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-6a01ff32-04b6-4001-9d54-9f4f3d42fc13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:01.346697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-6a01ff32-04b6-4001-9d54-9f4f3d42fc13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.162779 May 25 17:18:01.347263 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 519/1011] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:01 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:02.366872 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-478f6851-6caa-4637-9f57-d0f586fcf508 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:02.367573 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-478f6851-6caa-4637-9f57-d0f586fcf508 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:02.374743 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-478f6851-6caa-4637-9f57-d0f586fcf508 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:02.375199 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-478f6851-6caa-4637-9f57-d0f586fcf508 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:02.375966 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-478f6851-6caa-4637-9f57-d0f586fcf508 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:02.376408 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-478f6851-6caa-4637-9f57-d0f586fcf508 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:02.504086 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-478f6851-6caa-4637-9f57-d0f586fcf508 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:02.512260 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-478f6851-6caa-4637-9f57-d0f586fcf508 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.150964 May 25 17:18:02.512857 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 493/1012] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:02 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:03.530117 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-17e921cc-7437-44dd-97fc-0ec705e7c5a1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:03.531338 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-17e921cc-7437-44dd-97fc-0ec705e7c5a1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:03.539311 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17e921cc-7437-44dd-97fc-0ec705e7c5a1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:03.539765 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17e921cc-7437-44dd-97fc-0ec705e7c5a1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:03.540535 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17e921cc-7437-44dd-97fc-0ec705e7c5a1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:03.541023 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-17e921cc-7437-44dd-97fc-0ec705e7c5a1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:03.688916 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-17e921cc-7437-44dd-97fc-0ec705e7c5a1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:03.697567 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-17e921cc-7437-44dd-97fc-0ec705e7c5a1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1355 microversion: 2.1 time: 0.171556 May 25 17:18:03.698139 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 520/1013] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:03 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1355 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:04.714539 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-132d6694-c493-4db3-bed2-2738feda3973 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:04.715152 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-132d6694-c493-4db3-bed2-2738feda3973 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:04.721738 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-132d6694-c493-4db3-bed2-2738feda3973 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:04.722191 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-132d6694-c493-4db3-bed2-2738feda3973 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:04.723012 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-132d6694-c493-4db3-bed2-2738feda3973 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:04.723763 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-132d6694-c493-4db3-bed2-2738feda3973 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:04.855950 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-132d6694-c493-4db3-bed2-2738feda3973 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:04.864870 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-132d6694-c493-4db3-bed2-2738feda3973 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1545 microversion: 2.1 time: 0.154173 May 25 17:18:04.865443 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 494/1014] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:04 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:04.881651 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-1de14bd7-79e5-4fe1-b2a2-b4ed95e44a6e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:04.882278 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-1de14bd7-79e5-4fe1-b2a2-b4ed95e44a6e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:04.889203 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1de14bd7-79e5-4fe1-b2a2-b4ed95e44a6e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:04.889671 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1de14bd7-79e5-4fe1-b2a2-b4ed95e44a6e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:04.890454 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1de14bd7-79e5-4fe1-b2a2-b4ed95e44a6e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:04.890898 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-1de14bd7-79e5-4fe1-b2a2-b4ed95e44a6e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:05.022470 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-1de14bd7-79e5-4fe1-b2a2-b4ed95e44a6e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:05.029872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-1de14bd7-79e5-4fe1-b2a2-b4ed95e44a6e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1545 microversion: 2.1 time: 0.152222 May 25 17:18:05.030431 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 521/1015] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:04 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1545 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:05.046190 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2afc93b8-2a8e-44b7-ab49-0bb308733329 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:05.049646 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2afc93b8-2a8e-44b7-ab49-0bb308733329 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:05.050423 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2afc93b8-2a8e-44b7-ab49-0bb308733329 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Searching by: {'deleted': False, 'project_id': '195f7502e12548c5820b9b176a98b349'} {{(pid=117696) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 25 17:18:05.058242 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2afc93b8-2a8e-44b7-ab49-0bb308733329 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:05.058750 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2afc93b8-2a8e-44b7-ab49-0bb308733329 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:05.059495 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2afc93b8-2a8e-44b7-ab49-0bb308733329 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:05.060210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2afc93b8-2a8e-44b7-ab49-0bb308733329 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:05.152355 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.multi_cell_list [None req-2afc93b8-2a8e-44b7-ab49-0bb308733329 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117696) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 25 17:18:05.256050 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2afc93b8-2a8e-44b7-ab49-0bb308733329 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.212179 May 25 17:18:05.256658 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 495/1016] 10.222.0.31 () {58 vars in 1124 bytes} [Wed May 25 17:18:05 2022] GET /compute/v2.1/servers => generated 340 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:18:05.269445 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-035387f1-df99-4f58-ace3-d638058def13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:05.270089 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-035387f1-df99-4f58-ace3-d638058def13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:05.276003 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-035387f1-df99-4f58-ace3-d638058def13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:05.276449 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-035387f1-df99-4f58-ace3-d638058def13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:05.277239 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-035387f1-df99-4f58-ace3-d638058def13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:05.277672 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-035387f1-df99-4f58-ace3-d638058def13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:05.406404 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-035387f1-df99-4f58-ace3-d638058def13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:05.413805 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-035387f1-df99-4f58-ace3-d638058def13 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1545 microversion: 2.1 time: 0.148142 May 25 17:18:05.414367 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 522/1017] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:05 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1545 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:06.932857 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-001f7db6-8a8f-4cbc-9d50-d276415cf992 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a159076b-1eb7-480a-9c28-ae73ae0055e2"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:18:06.933900 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-001f7db6-8a8f-4cbc-9d50-d276415cf992 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:06.940750 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-001f7db6-8a8f-4cbc-9d50-d276415cf992 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:06.941203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-001f7db6-8a8f-4cbc-9d50-d276415cf992 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:06.942564 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-001f7db6-8a8f-4cbc-9d50-d276415cf992 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:06.943005 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-001f7db6-8a8f-4cbc-9d50-d276415cf992 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:07.179926 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-001f7db6-8a8f-4cbc-9d50-d276415cf992 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "POST /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250949 May 25 17:18:07.180543 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 496/1018] 10.222.0.31 () {60 vars in 1322 bytes} [Wed May 25 17:18:06 2022] POST /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:18:15.969519 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c348b793-759d-4a1a-a20e-b3991778d28b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:15.970136 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c348b793-759d-4a1a-a20e-b3991778d28b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:15.972327 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:15.973010 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=72 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:15.979225 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c348b793-759d-4a1a-a20e-b3991778d28b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:15.979755 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c348b793-759d-4a1a-a20e-b3991778d28b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:15.980526 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c348b793-759d-4a1a-a20e-b3991778d28b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:15.980992 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c348b793-759d-4a1a-a20e-b3991778d28b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:16.110348 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-c348b793-759d-4a1a-a20e-b3991778d28b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:16.119474 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c348b793-759d-4a1a-a20e-b3991778d28b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1591 microversion: 2.1 time: 0.153749 May 25 17:18:16.120310 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 523/1019] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:15 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1591 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:17.938711 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:17.939477 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:17.940149 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:17.945264 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-692b76ed-fb7b-4812-948d-20502f74aceb req-a32eafad-ca75-492c-99ff-bc2a4919fbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04921db8-8f39-49f2-b92b-0f01b6dcf48e", "tag": "5c08472c-6b26-4979-9138-9b2053d5447f"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:18:17.954646 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-692b76ed-fb7b-4812-948d-20502f74aceb req-a32eafad-ca75-492c-99ff-bc2a4919fbf4 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:17.955092 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-692b76ed-fb7b-4812-948d-20502f74aceb req-a32eafad-ca75-492c-99ff-bc2a4919fbf4 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:17.968493 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-692b76ed-fb7b-4812-948d-20502f74aceb req-a32eafad-ca75-492c-99ff-bc2a4919fbf4 service nova] Creating event network-changed:5c08472c-6b26-4979-9138-9b2053d5447f for instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e on hv-cinder-84330 May 25 17:18:17.974533 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-692b76ed-fb7b-4812-948d-20502f74aceb req-a32eafad-ca75-492c-99ff-bc2a4919fbf4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037071 May 25 17:18:17.975180 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 497/1020] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:18:18.904992 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-0e76062a-7117-45f7-81de-a9d86bdf47bc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-200558475"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:18:18.905384 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-0e76062a-7117-45f7-81de-a9d86bdf47bc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:18.912219 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e76062a-7117-45f7-81de-a9d86bdf47bc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:18.912670 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e76062a-7117-45f7-81de-a9d86bdf47bc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:18.913480 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e76062a-7117-45f7-81de-a9d86bdf47bc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:18.913920 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-0e76062a-7117-45f7-81de-a9d86bdf47bc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:19.043637 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.network.security_group_api [None req-0e76062a-7117-45f7-81de-a9d86bdf47bc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Adding security group cc5aa3fd-0a44-41d0-a4f9-0dd5c4b253c5 to port 5c08472c-6b26-4979-9138-9b2053d5447f May 25 17:18:19.687948 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-0e76062a-7117-45f7-81de-a9d86bdf47bc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "POST /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/action" status: 202 len: 0 microversion: 2.1 time: 0.787371 May 25 17:18:19.688939 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 524/1021] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:18:18 2022] POST /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 17:18:19.699828 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2c79da28-6fc9-49ce-ab26-4e69250d7377 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:19.700538 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2c79da28-6fc9-49ce-ab26-4e69250d7377 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:19.713468 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c79da28-6fc9-49ce-ab26-4e69250d7377 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:19.713918 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c79da28-6fc9-49ce-ab26-4e69250d7377 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:19.714702 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c79da28-6fc9-49ce-ab26-4e69250d7377 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:19.717000 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2c79da28-6fc9-49ce-ab26-4e69250d7377 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:19.996803 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-2dc1f765-a754-4529-80c6-42f1f723b6e1 req-55650309-b4d9-4aa3-a9f9-cbe272e0cf2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04921db8-8f39-49f2-b92b-0f01b6dcf48e", "tag": "5c08472c-6b26-4979-9138-9b2053d5447f"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:18:20.014947 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-2dc1f765-a754-4529-80c6-42f1f723b6e1 req-55650309-b4d9-4aa3-a9f9-cbe272e0cf2a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:20.015628 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-2dc1f765-a754-4529-80c6-42f1f723b6e1 req-55650309-b4d9-4aa3-a9f9-cbe272e0cf2a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:20.028828 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-2dc1f765-a754-4529-80c6-42f1f723b6e1 req-55650309-b4d9-4aa3-a9f9-cbe272e0cf2a service nova] Creating event network-changed:5c08472c-6b26-4979-9138-9b2053d5447f for instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e on hv-cinder-84330 May 25 17:18:20.051386 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-2dc1f765-a754-4529-80c6-42f1f723b6e1 req-55650309-b4d9-4aa3-a9f9-cbe272e0cf2a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065549 May 25 17:18:20.053132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 525/1022] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:18:20.063272 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2c79da28-6fc9-49ce-ab26-4e69250d7377 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:20.072831 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2c79da28-6fc9-49ce-ab26-4e69250d7377 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1637 microversion: 2.1 time: 0.379898 May 25 17:18:20.083155 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 498/1023] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:19 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1637 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:42.383511 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=6 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:42.384256 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=12 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:42.388712 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-067131c2-338f-4fc4-8613-4f5ba59efad0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:18:42.389895 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-067131c2-338f-4fc4-8613-4f5ba59efad0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:42.396975 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-067131c2-338f-4fc4-8613-4f5ba59efad0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:42.397432 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-067131c2-338f-4fc4-8613-4f5ba59efad0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:42.398198 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-067131c2-338f-4fc4-8613-4f5ba59efad0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:42.398639 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-067131c2-338f-4fc4-8613-4f5ba59efad0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:42.469976 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-067131c2-338f-4fc4-8613-4f5ba59efad0 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "POST /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/action" status: 202 len: 0 microversion: 2.1 time: 0.087835 May 25 17:18:42.470626 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 526/1024] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:18:42 2022] POST /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:18:42.478724 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-61b008a4-f56c-4986-bb36-cf249eb3f647 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:42.479382 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-61b008a4-f56c-4986-bb36-cf249eb3f647 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:42.482928 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=4 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:42.484546 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=8 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:42.489577 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61b008a4-f56c-4986-bb36-cf249eb3f647 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:42.490029 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61b008a4-f56c-4986-bb36-cf249eb3f647 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:42.490871 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61b008a4-f56c-4986-bb36-cf249eb3f647 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:42.491308 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61b008a4-f56c-4986-bb36-cf249eb3f647 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:42.733336 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-61b008a4-f56c-4986-bb36-cf249eb3f647 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:42.741229 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-61b008a4-f56c-4986-bb36-cf249eb3f647 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1748 microversion: 2.1 time: 0.266332 May 25 17:18:42.741832 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 499/1025] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:42 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1748 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:18:43.760485 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7640f2ee-7f93-4dd5-b7a6-70a8d2d6bbd3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:43.761222 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7640f2ee-7f93-4dd5-b7a6-70a8d2d6bbd3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:43.768099 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7640f2ee-7f93-4dd5-b7a6-70a8d2d6bbd3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:43.768662 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7640f2ee-7f93-4dd5-b7a6-70a8d2d6bbd3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:43.769466 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7640f2ee-7f93-4dd5-b7a6-70a8d2d6bbd3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:43.769907 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7640f2ee-7f93-4dd5-b7a6-70a8d2d6bbd3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:43.930795 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-7640f2ee-7f93-4dd5-b7a6-70a8d2d6bbd3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:43.939812 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7640f2ee-7f93-4dd5-b7a6-70a8d2d6bbd3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.184059 May 25 17:18:43.940526 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 527/1026] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:43 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:44.958309 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5f0d0813-9b75-4856-963c-44d92770739a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:44.958955 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5f0d0813-9b75-4856-963c-44d92770739a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:44.965763 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5f0d0813-9b75-4856-963c-44d92770739a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:44.966222 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5f0d0813-9b75-4856-963c-44d92770739a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:44.967019 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5f0d0813-9b75-4856-963c-44d92770739a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:44.968063 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5f0d0813-9b75-4856-963c-44d92770739a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:45.114050 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5f0d0813-9b75-4856-963c-44d92770739a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:45.121960 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5f0d0813-9b75-4856-963c-44d92770739a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.167603 May 25 17:18:45.122529 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 500/1027] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:44 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:18:46.139251 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-522b617f-55d0-499a-b63c-69faf91f4587 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:46.139906 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-522b617f-55d0-499a-b63c-69faf91f4587 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:46.146557 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-522b617f-55d0-499a-b63c-69faf91f4587 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:46.147007 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-522b617f-55d0-499a-b63c-69faf91f4587 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:46.147782 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-522b617f-55d0-499a-b63c-69faf91f4587 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:46.148217 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-522b617f-55d0-499a-b63c-69faf91f4587 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:46.297131 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-522b617f-55d0-499a-b63c-69faf91f4587 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:46.305075 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-522b617f-55d0-499a-b63c-69faf91f4587 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.169628 May 25 17:18:46.305632 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 528/1028] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:46 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:47.322870 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-10de520f-ca58-456c-8c60-040011469df2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:47.323482 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-10de520f-ca58-456c-8c60-040011469df2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:47.331054 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-10de520f-ca58-456c-8c60-040011469df2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:47.331508 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-10de520f-ca58-456c-8c60-040011469df2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:47.332271 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-10de520f-ca58-456c-8c60-040011469df2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:47.332762 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-10de520f-ca58-456c-8c60-040011469df2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:47.477095 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-10de520f-ca58-456c-8c60-040011469df2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:47.485551 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-10de520f-ca58-456c-8c60-040011469df2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.166611 May 25 17:18:47.486119 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 501/1029] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:47 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:48.503365 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d677c997-5939-4c50-997e-eb8a35391e1b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:48.504013 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d677c997-5939-4c50-997e-eb8a35391e1b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:48.510681 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d677c997-5939-4c50-997e-eb8a35391e1b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:48.511137 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d677c997-5939-4c50-997e-eb8a35391e1b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:48.511900 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d677c997-5939-4c50-997e-eb8a35391e1b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:48.512347 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d677c997-5939-4c50-997e-eb8a35391e1b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:48.656429 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d677c997-5939-4c50-997e-eb8a35391e1b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:48.664390 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d677c997-5939-4c50-997e-eb8a35391e1b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.165608 May 25 17:18:48.664984 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 529/1030] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:48 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:49.681613 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6fa546fd-a4e9-4624-a23d-a97e8e50701d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:49.682237 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6fa546fd-a4e9-4624-a23d-a97e8e50701d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:49.689903 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6fa546fd-a4e9-4624-a23d-a97e8e50701d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:49.690353 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6fa546fd-a4e9-4624-a23d-a97e8e50701d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:49.691123 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6fa546fd-a4e9-4624-a23d-a97e8e50701d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:49.691558 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6fa546fd-a4e9-4624-a23d-a97e8e50701d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:49.833272 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6fa546fd-a4e9-4624-a23d-a97e8e50701d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:49.841310 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6fa546fd-a4e9-4624-a23d-a97e8e50701d tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.163674 May 25 17:18:49.841881 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 502/1031] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:49 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:50.859142 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f1b1363f-b835-4f8a-8bb7-df9552c65296 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:50.859773 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f1b1363f-b835-4f8a-8bb7-df9552c65296 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:50.866259 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f1b1363f-b835-4f8a-8bb7-df9552c65296 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:50.866704 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f1b1363f-b835-4f8a-8bb7-df9552c65296 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:50.867486 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f1b1363f-b835-4f8a-8bb7-df9552c65296 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:50.867918 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f1b1363f-b835-4f8a-8bb7-df9552c65296 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:51.008052 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f1b1363f-b835-4f8a-8bb7-df9552c65296 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:51.016835 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f1b1363f-b835-4f8a-8bb7-df9552c65296 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.161625 May 25 17:18:51.017398 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 530/1032] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:50 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:52.034975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d7e789c1-9821-4c86-97ea-1d58b8488be5 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:52.035606 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d7e789c1-9821-4c86-97ea-1d58b8488be5 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:52.041971 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d7e789c1-9821-4c86-97ea-1d58b8488be5 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:52.042424 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d7e789c1-9821-4c86-97ea-1d58b8488be5 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:52.043184 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d7e789c1-9821-4c86-97ea-1d58b8488be5 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:52.043618 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d7e789c1-9821-4c86-97ea-1d58b8488be5 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:52.185466 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d7e789c1-9821-4c86-97ea-1d58b8488be5 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:52.194247 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d7e789c1-9821-4c86-97ea-1d58b8488be5 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.164057 May 25 17:18:52.194810 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 503/1033] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:52 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:53.211212 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f36dd189-075c-440b-828a-6d3b33c6a10e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:53.211826 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f36dd189-075c-440b-828a-6d3b33c6a10e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:53.219512 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f36dd189-075c-440b-828a-6d3b33c6a10e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:53.219967 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f36dd189-075c-440b-828a-6d3b33c6a10e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:53.220768 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f36dd189-075c-440b-828a-6d3b33c6a10e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:53.221215 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f36dd189-075c-440b-828a-6d3b33c6a10e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:53.369660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f36dd189-075c-440b-828a-6d3b33c6a10e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:53.377872 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f36dd189-075c-440b-828a-6d3b33c6a10e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.170504 May 25 17:18:53.378438 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 531/1034] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:53 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:18:54.395226 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0e69c0f2-90c0-44bc-8041-4808787e7bf2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:54.395844 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0e69c0f2-90c0-44bc-8041-4808787e7bf2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:54.402163 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e69c0f2-90c0-44bc-8041-4808787e7bf2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:54.402615 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e69c0f2-90c0-44bc-8041-4808787e7bf2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:54.403384 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e69c0f2-90c0-44bc-8041-4808787e7bf2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:54.403822 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e69c0f2-90c0-44bc-8041-4808787e7bf2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:54.545737 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0e69c0f2-90c0-44bc-8041-4808787e7bf2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:54.557615 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0e69c0f2-90c0-44bc-8041-4808787e7bf2 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.166373 May 25 17:18:54.558210 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 504/1035] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:54 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:55.575875 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-20553714-6005-4da6-b85c-6bb50a6f7bd1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:55.576485 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-20553714-6005-4da6-b85c-6bb50a6f7bd1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:55.583081 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-20553714-6005-4da6-b85c-6bb50a6f7bd1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:55.583537 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-20553714-6005-4da6-b85c-6bb50a6f7bd1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:55.584306 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-20553714-6005-4da6-b85c-6bb50a6f7bd1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:55.584774 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-20553714-6005-4da6-b85c-6bb50a6f7bd1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:55.729099 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-20553714-6005-4da6-b85c-6bb50a6f7bd1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:55.737833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-20553714-6005-4da6-b85c-6bb50a6f7bd1 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.165850 May 25 17:18:55.738397 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 532/1036] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:55 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:56.755773 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1bd558a6-6803-4734-8d81-4e465f906b7a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:56.756386 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1bd558a6-6803-4734-8d81-4e465f906b7a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:56.763183 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bd558a6-6803-4734-8d81-4e465f906b7a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:56.763635 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bd558a6-6803-4734-8d81-4e465f906b7a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:56.764401 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bd558a6-6803-4734-8d81-4e465f906b7a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:56.764882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bd558a6-6803-4734-8d81-4e465f906b7a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:56.913921 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1bd558a6-6803-4734-8d81-4e465f906b7a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:56.921927 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1bd558a6-6803-4734-8d81-4e465f906b7a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.170084 May 25 17:18:56.922942 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 505/1037] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:56 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:57.940176 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4eaa9e07-2462-4746-b77f-44344dc8116f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:57.940756 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4eaa9e07-2462-4746-b77f-44344dc8116f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:57.948812 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4eaa9e07-2462-4746-b77f-44344dc8116f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:57.949268 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4eaa9e07-2462-4746-b77f-44344dc8116f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:57.950080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4eaa9e07-2462-4746-b77f-44344dc8116f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:57.950538 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4eaa9e07-2462-4746-b77f-44344dc8116f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:58.096764 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-4eaa9e07-2462-4746-b77f-44344dc8116f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:58.104709 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4eaa9e07-2462-4746-b77f-44344dc8116f tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.168823 May 25 17:18:58.105285 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 533/1038] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:57 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:18:59.121868 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-92fcad0a-0c7e-420b-a781-1764b89f3e31 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:18:59.122504 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-92fcad0a-0c7e-420b-a781-1764b89f3e31 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:18:59.129012 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-92fcad0a-0c7e-420b-a781-1764b89f3e31 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:59.129464 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-92fcad0a-0c7e-420b-a781-1764b89f3e31 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:59.130224 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-92fcad0a-0c7e-420b-a781-1764b89f3e31 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:18:59.130660 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-92fcad0a-0c7e-420b-a781-1764b89f3e31 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:18:59.279860 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-92fcad0a-0c7e-420b-a781-1764b89f3e31 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:18:59.288532 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-92fcad0a-0c7e-420b-a781-1764b89f3e31 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1753 microversion: 2.1 time: 0.170491 May 25 17:18:59.289126 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 506/1039] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:18:59 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:00.306539 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-031f1e2a-0c83-4356-a789-681c992390cc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:00.307157 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-031f1e2a-0c83-4356-a789-681c992390cc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:00.314058 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-031f1e2a-0c83-4356-a789-681c992390cc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:00.314515 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-031f1e2a-0c83-4356-a789-681c992390cc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:00.315287 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-031f1e2a-0c83-4356-a789-681c992390cc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:00.315728 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-031f1e2a-0c83-4356-a789-681c992390cc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:00.457800 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-031f1e2a-0c83-4356-a789-681c992390cc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:00.465653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-031f1e2a-0c83-4356-a789-681c992390cc tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1756 microversion: 2.1 time: 0.163031 May 25 17:19:00.466227 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 534/1040] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:00 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:17.435528 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:19:17.436044 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Wed May 25 17:19:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:19:20.932255 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1510436002", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-500528931", "security_groups": [{"name": "tempest-secgroup-smoke-215202645"}], "block_device_mapping_v2": [{"uuid": "683b3960-0e80-45c4-925e-cb3e1700f0f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f83d3faf-d265-477f-8499-04e56bb140df"}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:19:20.942447 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=16 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:20.943248 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=48 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:21.160104 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] validate_networks() for [('f83d3faf-d265-477f-8499-04e56bb140df', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 17:19:21.632074 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 17:19:21.632486 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 17:19:21.632985 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 17:19:21.633400 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 17:19:21.633805 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 17:19:21.643462 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:21.643906 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:21.644736 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:21.645170 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:21.661522 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Getting quotas for project df9bc8d103cf40e1b8d984f1947e7c5d. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 17:19:21.665461 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Getting quotas for user 47642301725e4023aba48b2a3a64d5b9 and project df9bc8d103cf40e1b8d984f1947e7c5d. Resources: {'ram', 'instances', 'cores'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 17:19:21.725838 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 17:19:21.727918 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='683b3960-0e80-45c4-925e-cb3e1700f0f2',volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 17:19:21.855234 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d682e8cf-d5d0-4192-83a9-abce78b640d2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.926909 May 25 17:19:21.855870 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 507/1041] 10.222.0.31 () {60 vars in 1146 bytes} [Wed May 25 17:19:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 17:19:21.866138 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-bb76b490-07da-407f-ba24-e525e6f3fa5d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:21.866796 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-bb76b490-07da-407f-ba24-e525e6f3fa5d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:21.869121 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=18 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:21.870392 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:21.981393 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-bb76b490-07da-407f-ba24-e525e6f3fa5d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:21.988096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-bb76b490-07da-407f-ba24-e525e6f3fa5d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1094 microversion: 2.1 time: 0.125937 May 25 17:19:21.988669 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 535/1042] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:21 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1094 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:23.005745 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b466ba96-4633-4d1b-859b-1278a4ad080d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:23.006342 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b466ba96-4633-4d1b-859b-1278a4ad080d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:23.013962 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b466ba96-4633-4d1b-859b-1278a4ad080d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:23.014489 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b466ba96-4633-4d1b-859b-1278a4ad080d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:23.015809 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b466ba96-4633-4d1b-859b-1278a4ad080d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:23.015809 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b466ba96-4633-4d1b-859b-1278a4ad080d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:23.113250 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b466ba96-4633-4d1b-859b-1278a4ad080d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:23.120641 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b466ba96-4633-4d1b-859b-1278a4ad080d tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1210 microversion: 2.1 time: 0.119191 May 25 17:19:23.121244 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 508/1043] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:23 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:24.139214 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8495bf55-115e-4965-8afa-96d3ff54b9b2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:24.139834 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8495bf55-115e-4965-8afa-96d3ff54b9b2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:24.149718 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8495bf55-115e-4965-8afa-96d3ff54b9b2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:24.150176 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8495bf55-115e-4965-8afa-96d3ff54b9b2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:24.151185 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8495bf55-115e-4965-8afa-96d3ff54b9b2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:24.152195 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8495bf55-115e-4965-8afa-96d3ff54b9b2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:24.309846 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8495bf55-115e-4965-8afa-96d3ff54b9b2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:24.323975 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-ff31aec0-4a88-4d5e-8f04-d355cc863b04 req-dc9105a6-e4af-47ff-a1a2-15cb9095496f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a", "tag": "9c8e824c-81df-4ecf-bf7a-aa05917e0cd1"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:19:24.331531 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8495bf55-115e-4965-8afa-96d3ff54b9b2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1265 microversion: 2.1 time: 0.196567 May 25 17:19:24.341623 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 536/1044] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:24 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:24.351783 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-ff31aec0-4a88-4d5e-8f04-d355cc863b04 req-dc9105a6-e4af-47ff-a1a2-15cb9095496f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:24.352722 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-ff31aec0-4a88-4d5e-8f04-d355cc863b04 req-dc9105a6-e4af-47ff-a1a2-15cb9095496f service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:24.367158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-ff31aec0-4a88-4d5e-8f04-d355cc863b04 req-dc9105a6-e4af-47ff-a1a2-15cb9095496f service nova] Creating event network-changed:9c8e824c-81df-4ecf-bf7a-aa05917e0cd1 for instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a on hv-cinder-84330 May 25 17:19:24.373262 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-ff31aec0-4a88-4d5e-8f04-d355cc863b04 req-dc9105a6-e4af-47ff-a1a2-15cb9095496f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053937 May 25 17:19:24.374104 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 509/1045] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:19:25.350730 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8c2e7840-3075-456f-842b-9fef757ce9a0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:25.351400 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8c2e7840-3075-456f-842b-9fef757ce9a0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:25.358836 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8c2e7840-3075-456f-842b-9fef757ce9a0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:25.359290 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8c2e7840-3075-456f-842b-9fef757ce9a0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:25.360057 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8c2e7840-3075-456f-842b-9fef757ce9a0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:25.360494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8c2e7840-3075-456f-842b-9fef757ce9a0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:25.500575 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8c2e7840-3075-456f-842b-9fef757ce9a0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:25.508039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8c2e7840-3075-456f-842b-9fef757ce9a0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1265 microversion: 2.1 time: 0.161245 May 25 17:19:25.508646 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 537/1046] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:25 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:26.527998 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d2f2ce0d-f492-4554-a696-68e60b3c8dfa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:26.528697 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d2f2ce0d-f492-4554-a696-68e60b3c8dfa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:26.535184 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d2f2ce0d-f492-4554-a696-68e60b3c8dfa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:26.535673 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d2f2ce0d-f492-4554-a696-68e60b3c8dfa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:26.536422 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d2f2ce0d-f492-4554-a696-68e60b3c8dfa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:26.536894 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d2f2ce0d-f492-4554-a696-68e60b3c8dfa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:26.669652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d2f2ce0d-f492-4554-a696-68e60b3c8dfa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:26.677443 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d2f2ce0d-f492-4554-a696-68e60b3c8dfa tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1265 microversion: 2.1 time: 0.155291 May 25 17:19:26.678020 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 510/1047] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:26 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:27.694896 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f27cdb2e-69a0-4700-9bdb-eb858df34b46 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:27.695508 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f27cdb2e-69a0-4700-9bdb-eb858df34b46 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:27.702148 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f27cdb2e-69a0-4700-9bdb-eb858df34b46 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:27.702605 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f27cdb2e-69a0-4700-9bdb-eb858df34b46 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:27.703376 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f27cdb2e-69a0-4700-9bdb-eb858df34b46 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:27.703817 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f27cdb2e-69a0-4700-9bdb-eb858df34b46 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:27.845352 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f27cdb2e-69a0-4700-9bdb-eb858df34b46 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:27.852857 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f27cdb2e-69a0-4700-9bdb-eb858df34b46 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1265 microversion: 2.1 time: 0.161830 May 25 17:19:27.853416 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 538/1048] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:27 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:28.869658 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fd1ce7d7-bbb5-4805-aab0-b62d49711bd7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:28.870272 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fd1ce7d7-bbb5-4805-aab0-b62d49711bd7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:28.877463 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd1ce7d7-bbb5-4805-aab0-b62d49711bd7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:28.877919 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd1ce7d7-bbb5-4805-aab0-b62d49711bd7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:28.878681 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd1ce7d7-bbb5-4805-aab0-b62d49711bd7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:28.879122 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd1ce7d7-bbb5-4805-aab0-b62d49711bd7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:29.007338 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fd1ce7d7-bbb5-4805-aab0-b62d49711bd7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:29.015350 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fd1ce7d7-bbb5-4805-aab0-b62d49711bd7 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1265 microversion: 2.1 time: 0.149608 May 25 17:19:29.015922 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 511/1049] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:28 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:30.031436 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-3a8e093e-84df-49e4-9799-85be82770970 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:30.032039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-3a8e093e-84df-49e4-9799-85be82770970 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:30.038480 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3a8e093e-84df-49e4-9799-85be82770970 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:30.038932 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3a8e093e-84df-49e4-9799-85be82770970 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:30.039705 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3a8e093e-84df-49e4-9799-85be82770970 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:30.040146 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-3a8e093e-84df-49e4-9799-85be82770970 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:30.170237 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-3a8e093e-84df-49e4-9799-85be82770970 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:30.177788 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-3a8e093e-84df-49e4-9799-85be82770970 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1265 microversion: 2.1 time: 0.150333 May 25 17:19:30.178412 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 539/1050] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:30 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:31.195478 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-72e3cb7c-1fc6-48e9-99cd-0ace33790423 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:31.196077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-72e3cb7c-1fc6-48e9-99cd-0ace33790423 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:31.203182 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-72e3cb7c-1fc6-48e9-99cd-0ace33790423 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:31.203629 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-72e3cb7c-1fc6-48e9-99cd-0ace33790423 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:31.204386 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-72e3cb7c-1fc6-48e9-99cd-0ace33790423 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:31.204847 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-72e3cb7c-1fc6-48e9-99cd-0ace33790423 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:31.335970 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-72e3cb7c-1fc6-48e9-99cd-0ace33790423 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:31.343709 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-72e3cb7c-1fc6-48e9-99cd-0ace33790423 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1265 microversion: 2.1 time: 0.152203 May 25 17:19:31.344281 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 512/1051] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:31 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:32.361119 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e8b4af09-1309-413d-a931-ec231981268c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:32.361681 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e8b4af09-1309-413d-a931-ec231981268c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:32.363991 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell0:SELECT=2 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:32.369257 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8b4af09-1309-413d-a931-ec231981268c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:32.369701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8b4af09-1309-413d-a931-ec231981268c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:32.370485 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8b4af09-1309-413d-a931-ec231981268c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:32.370912 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e8b4af09-1309-413d-a931-ec231981268c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:32.505833 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e8b4af09-1309-413d-a931-ec231981268c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:32.513615 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e8b4af09-1309-413d-a931-ec231981268c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1265 microversion: 2.1 time: 0.157001 May 25 17:19:32.514180 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 540/1052] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:32 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:33.389150 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-502b0774-108e-4bcf-9dd4-d02bf5dc01e9 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-200558475"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:19:33.389803 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-502b0774-108e-4bcf-9dd4-d02bf5dc01e9 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:33.392010 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:33.392784 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:33.399695 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-502b0774-108e-4bcf-9dd4-d02bf5dc01e9 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:33.400146 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-502b0774-108e-4bcf-9dd4-d02bf5dc01e9 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:33.400940 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-502b0774-108e-4bcf-9dd4-d02bf5dc01e9 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:33.401378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-502b0774-108e-4bcf-9dd4-d02bf5dc01e9 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:33.526051 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.network.security_group_api [None req-502b0774-108e-4bcf-9dd4-d02bf5dc01e9 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Removing security group cc5aa3fd-0a44-41d0-a4f9-0dd5c4b253c5 from port 5c08472c-6b26-4979-9138-9b2053d5447f May 25 17:19:33.531619 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d697c563-717b-49ee-9dd0-95bd932cfceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:33.532329 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d697c563-717b-49ee-9dd0-95bd932cfceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:33.539142 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d697c563-717b-49ee-9dd0-95bd932cfceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:33.539668 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d697c563-717b-49ee-9dd0-95bd932cfceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:33.540507 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d697c563-717b-49ee-9dd0-95bd932cfceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:33.541039 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d697c563-717b-49ee-9dd0-95bd932cfceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:33.680549 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-d697c563-717b-49ee-9dd0-95bd932cfceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:33.688498 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d697c563-717b-49ee-9dd0-95bd932cfceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1265 microversion: 2.1 time: 0.160677 May 25 17:19:33.689392 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 541/1053] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:33 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:33.851451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-21fdb030-365c-4504-b0d5-eaa56de3681c req-773e3547-2e6a-4004-b60f-b432b1e2a38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a", "name": "network-vif-plugged", "status": "completed", "tag": "9c8e824c-81df-4ecf-bf7a-aa05917e0cd1"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:19:33.868042 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-21fdb030-365c-4504-b0d5-eaa56de3681c req-773e3547-2e6a-4004-b60f-b432b1e2a38a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:33.868762 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-21fdb030-365c-4504-b0d5-eaa56de3681c req-773e3547-2e6a-4004-b60f-b432b1e2a38a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:33.888421 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-21fdb030-365c-4504-b0d5-eaa56de3681c req-773e3547-2e6a-4004-b60f-b432b1e2a38a service nova] Creating event network-vif-plugged:9c8e824c-81df-4ecf-bf7a-aa05917e0cd1 for instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a on hv-cinder-84330 May 25 17:19:33.896707 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-21fdb030-365c-4504-b0d5-eaa56de3681c req-773e3547-2e6a-4004-b60f-b432b1e2a38a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049603 May 25 17:19:33.897620 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 542/1054] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:19:33.943554 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-502b0774-108e-4bcf-9dd4-d02bf5dc01e9 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "POST /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/action" status: 202 len: 0 microversion: 2.1 time: 0.558872 May 25 17:19:33.949034 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 513/1055] 10.222.0.31 () {60 vars in 1277 bytes} [Wed May 25 17:19:33 2022] POST /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:19:33.958689 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-655e025a-f27b-48f1-b349-d1c4610f2ce6 req-cdaa8da4-b4ff-49e3-895a-43b0303ebeb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04921db8-8f39-49f2-b92b-0f01b6dcf48e", "tag": "5c08472c-6b26-4979-9138-9b2053d5447f"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:19:33.972140 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-655e025a-f27b-48f1-b349-d1c4610f2ce6 req-cdaa8da4-b4ff-49e3-895a-43b0303ebeb0 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:33.973038 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-655e025a-f27b-48f1-b349-d1c4610f2ce6 req-cdaa8da4-b4ff-49e3-895a-43b0303ebeb0 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:33.997138 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-655e025a-f27b-48f1-b349-d1c4610f2ce6 req-cdaa8da4-b4ff-49e3-895a-43b0303ebeb0 service nova] Creating event network-changed:5c08472c-6b26-4979-9138-9b2053d5447f for instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e on hv-cinder-84330 May 25 17:19:34.016827 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-655e025a-f27b-48f1-b349-d1c4610f2ce6 req-cdaa8da4-b4ff-49e3-895a-43b0303ebeb0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062834 May 25 17:19:34.017484 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 543/1056] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:19:34.706717 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9bc368d4-b9d8-41f2-9fdc-9a3edad72cdc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:34.707522 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9bc368d4-b9d8-41f2-9fdc-9a3edad72cdc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:34.713636 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9bc368d4-b9d8-41f2-9fdc-9a3edad72cdc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:34.714225 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9bc368d4-b9d8-41f2-9fdc-9a3edad72cdc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:34.715062 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9bc368d4-b9d8-41f2-9fdc-9a3edad72cdc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:34.715578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9bc368d4-b9d8-41f2-9fdc-9a3edad72cdc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:34.927655 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9bc368d4-b9d8-41f2-9fdc-9a3edad72cdc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:34.935126 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9bc368d4-b9d8-41f2-9fdc-9a3edad72cdc tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1265 microversion: 2.1 time: 0.233123 May 25 17:19:34.935704 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 514/1057] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:34 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:35.712482 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-d47a02db-c62a-476b-963f-d9c987a84482 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:35.713766 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-d47a02db-c62a-476b-963f-d9c987a84482 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:35.726923 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d47a02db-c62a-476b-963f-d9c987a84482 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:35.727660 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d47a02db-c62a-476b-963f-d9c987a84482 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:35.729674 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d47a02db-c62a-476b-963f-d9c987a84482 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:35.730246 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-d47a02db-c62a-476b-963f-d9c987a84482 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:35.825377 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-d47a02db-c62a-476b-963f-d9c987a84482 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lazy-loading 'services' on Instance uuid 04921db8-8f39-49f2-b92b-0f01b6dcf48e {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:19:35.903695 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-d47a02db-c62a-476b-963f-d9c987a84482 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "DELETE /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments/a159076b-1eb7-480a-9c28-ae73ae0055e2" status: 202 len: 0 microversion: 2.1 time: 0.198968 May 25 17:19:35.904335 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 544/1058] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:19:35 2022] DELETE /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments/a159076b-1eb7-480a-9c28-ae73ae0055e2 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:19:35.913556 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-99cb873e-e788-4602-a04c-adc3430ac214 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:35.915214 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-99cb873e-e788-4602-a04c-adc3430ac214 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:35.922349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-99cb873e-e788-4602-a04c-adc3430ac214 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:35.922891 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-99cb873e-e788-4602-a04c-adc3430ac214 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:35.923792 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-99cb873e-e788-4602-a04c-adc3430ac214 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:35.924216 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-99cb873e-e788-4602-a04c-adc3430ac214 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:35.954029 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-e2972313-5f8f-4bd7-afc1-02fbb627a43f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:35.955801 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-e2972313-5f8f-4bd7-afc1-02fbb627a43f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:35.957713 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-99cb873e-e788-4602-a04c-adc3430ac214 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048553 May 25 17:19:35.958802 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 515/1059] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:19:35 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:19:35.966677 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2972313-5f8f-4bd7-afc1-02fbb627a43f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:35.967132 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2972313-5f8f-4bd7-afc1-02fbb627a43f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:35.967933 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2972313-5f8f-4bd7-afc1-02fbb627a43f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:35.968629 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-e2972313-5f8f-4bd7-afc1-02fbb627a43f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:36.033146 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-0226b4c2-4bcb-471f-bea6-601ded54d6b3 req-a5b640dc-43af-48f0-af1c-318245c67df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04921db8-8f39-49f2-b92b-0f01b6dcf48e", "tag": "5c08472c-6b26-4979-9138-9b2053d5447f"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:19:36.041127 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-0226b4c2-4bcb-471f-bea6-601ded54d6b3 req-a5b640dc-43af-48f0-af1c-318245c67df1 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:36.041898 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-0226b4c2-4bcb-471f-bea6-601ded54d6b3 req-a5b640dc-43af-48f0-af1c-318245c67df1 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:36.056015 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-0226b4c2-4bcb-471f-bea6-601ded54d6b3 req-a5b640dc-43af-48f0-af1c-318245c67df1 service nova] Creating event network-changed:5c08472c-6b26-4979-9138-9b2053d5447f for instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e on hv-cinder-84330 May 25 17:19:36.061275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-0226b4c2-4bcb-471f-bea6-601ded54d6b3 req-a5b640dc-43af-48f0-af1c-318245c67df1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032459 May 25 17:19:36.063335 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 516/1060] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:19:36.106590 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-e2972313-5f8f-4bd7-afc1-02fbb627a43f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:36.115197 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-e2972313-5f8f-4bd7-afc1-02fbb627a43f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1452 microversion: 2.1 time: 0.165888 May 25 17:19:36.115769 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 545/1061] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:35 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:36.132349 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-089377b7-cc16-4286-a9b5-440e0627e1ec tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:36.133106 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-089377b7-cc16-4286-a9b5-440e0627e1ec tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:36.139305 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-089377b7-cc16-4286-a9b5-440e0627e1ec tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:36.139912 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-089377b7-cc16-4286-a9b5-440e0627e1ec tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:36.140745 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-089377b7-cc16-4286-a9b5-440e0627e1ec tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:36.141193 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-089377b7-cc16-4286-a9b5-440e0627e1ec tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:36.289279 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-089377b7-cc16-4286-a9b5-440e0627e1ec tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:36.298294 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-089377b7-cc16-4286-a9b5-440e0627e1ec tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1452 microversion: 2.1 time: 0.169356 May 25 17:19:36.299155 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 517/1062] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:36 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:36.970637 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-b5a7d3ab-0f6a-46b7-a39b-277d4d745d7e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:36.971582 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-b5a7d3ab-0f6a-46b7-a39b-277d4d745d7e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:36.977627 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b5a7d3ab-0f6a-46b7-a39b-277d4d745d7e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:36.978082 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b5a7d3ab-0f6a-46b7-a39b-277d4d745d7e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:36.978855 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b5a7d3ab-0f6a-46b7-a39b-277d4d745d7e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:36.979297 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-b5a7d3ab-0f6a-46b7-a39b-277d4d745d7e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:37.008576 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-b5a7d3ab-0f6a-46b7-a39b-277d4d745d7e tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042873 May 25 17:19:37.009185 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 546/1063] 10.222.0.31 () {58 vars in 1301 bytes} [Wed May 25 17:19:36 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 17:19:37.020337 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4ab5ce0d-4cd5-4afb-91ec-7d816d8f87f3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:37.020872 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4ab5ce0d-4cd5-4afb-91ec-7d816d8f87f3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:37.027382 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4ab5ce0d-4cd5-4afb-91ec-7d816d8f87f3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:37.027830 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4ab5ce0d-4cd5-4afb-91ec-7d816d8f87f3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:37.028597 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4ab5ce0d-4cd5-4afb-91ec-7d816d8f87f3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:37.029058 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4ab5ce0d-4cd5-4afb-91ec-7d816d8f87f3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:37.108751 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-4ab5ce0d-4cd5-4afb-91ec-7d816d8f87f3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] HTTP exception thrown: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e is not attached to volume a159076b-1eb7-480a-9c28-ae73ae0055e2 May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4ab5ce0d-4cd5-4afb-91ec-7d816d8f87f3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Request method failure captured: May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments/a159076b-1eb7-480a-9c28-ae73ae0055e2 HTTP/1.1 May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmShOIKhIyos9Yp34r3fA-VVuRPdD-RDGHCjWW9XMjSmfaXck9RVbOm52rt6fklQFC4fj55ifaFbUKS4vsH_Ahm7NNoD4ljJEzSM5vYoPSBJK4hGUCLtPfhpH60ObYaltVsxEX2Cl7U9MrbC8mBvy4XPmG01XYHrrBssQLpJBOaSSeA May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 195f7502e12548c5820b9b176a98b349 May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-TestMinimumBasicScenario-2106354435 May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:19:37.111240 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_195f7502e12548c5820b9b176a98b349"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/195f7502e12548c5820b9b176a98b349"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/195f7502e12548c5820b9b176a98b349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/195f7502e12548c5820b9b176a98b349"}]}] May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-TestMinimumBasicScenario-2106354435 May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 195f7502e12548c5820b9b176a98b349 May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2106354435 May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-TestMinimumBasicScenario-2106354435-project May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 03703b61e1d3442aaf8346abb5159725 May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-TestMinimumBasicScenario-2106354435-project May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:19:37.112913 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e is not attached to volume a159076b-1eb7-480a-9c28-ae73ae0055e2 May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'server_id': '04921db8-8f39-49f2-b92b-0f01b6dcf48e', 'id': 'a159076b-1eb7-480a-9c28-ae73ae0055e2'} May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a159076b-1eb7-480a-9c28-ae73ae0055e2. May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:19:37.113873 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e is not attached to volume a159076b-1eb7-480a-9c28-ae73ae0055e2 May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e is not attached to volume a159076b-1eb7-480a-9c28-ae73ae0055e2 May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:19:37.115858 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4ab5ce0d-4cd5-4afb-91ec-7d816d8f87f3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Returning 404 to user: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e is not attached to volume a159076b-1eb7-480a-9c28-ae73ae0055e2 {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:19:37.118124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4ab5ce0d-4cd5-4afb-91ec-7d816d8f87f3 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "DELETE /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments/a159076b-1eb7-480a-9c28-ae73ae0055e2" status: 404 len: 154 microversion: 2.1 time: 0.096307 May 25 17:19:37.118124 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 518/1064] 10.222.0.31 () {58 vars in 1415 bytes} [Wed May 25 17:19:37 2022] DELETE /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e/os-volume_attachments/a159076b-1eb7-480a-9c28-ae73ae0055e2 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:19:38.269548 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-c0cfe207-4bfa-4fee-8eff-6d6a08d7e639 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:38.270371 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c0cfe207-4bfa-4fee-8eff-6d6a08d7e639 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:38.283792 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c0cfe207-4bfa-4fee-8eff-6d6a08d7e639 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:38.285080 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c0cfe207-4bfa-4fee-8eff-6d6a08d7e639 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:38.286068 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c0cfe207-4bfa-4fee-8eff-6d6a08d7e639 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:38.286690 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-c0cfe207-4bfa-4fee-8eff-6d6a08d7e639 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:38.314794 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-c0cfe207-4bfa-4fee-8eff-6d6a08d7e639 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:19:38.410692 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-c0cfe207-4bfa-4fee-8eff-6d6a08d7e639 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "DELETE /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 204 len: 0 microversion: 2.1 time: 0.146286 May 25 17:19:38.411645 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 547/1065] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:19:38 2022] DELETE /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:19:38.413391 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-73b58c11-cedc-4cd0-a4a8-81490e20d8b2 req-922cd694-6d50-4de4-b655-9d8b98d82207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a", "tag": "9c8e824c-81df-4ecf-bf7a-aa05917e0cd1"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:19:38.420514 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-83034ca9-be47-45db-8e2b-b9bf2caa2187 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:38.422082 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-83034ca9-be47-45db-8e2b-b9bf2caa2187 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:38.424395 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-73b58c11-cedc-4cd0-a4a8-81490e20d8b2 req-922cd694-6d50-4de4-b655-9d8b98d82207 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:38.425000 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-73b58c11-cedc-4cd0-a4a8-81490e20d8b2 req-922cd694-6d50-4de4-b655-9d8b98d82207 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:38.428596 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-83034ca9-be47-45db-8e2b-b9bf2caa2187 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:38.429312 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-83034ca9-be47-45db-8e2b-b9bf2caa2187 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:38.430093 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-83034ca9-be47-45db-8e2b-b9bf2caa2187 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:38.430537 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-83034ca9-be47-45db-8e2b-b9bf2caa2187 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:38.435847 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-73b58c11-cedc-4cd0-a4a8-81490e20d8b2 req-922cd694-6d50-4de4-b655-9d8b98d82207 service nova] Creating event network-changed:9c8e824c-81df-4ecf-bf7a-aa05917e0cd1 for instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a on hv-cinder-84330 May 25 17:19:38.442136 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-73b58c11-cedc-4cd0-a4a8-81490e20d8b2 req-922cd694-6d50-4de4-b655-9d8b98d82207 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109265 May 25 17:19:38.445763 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 519/1066] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 17:19:38.568032 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-83034ca9-be47-45db-8e2b-b9bf2caa2187 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:38.575776 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-83034ca9-be47-45db-8e2b-b9bf2caa2187 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1551 microversion: 2.1 time: 0.159400 May 25 17:19:38.576345 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 548/1067] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:38 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:39.594945 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6e77a8de-1a40-466d-9266-30b55dc3cb8b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:39.595578 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6e77a8de-1a40-466d-9266-30b55dc3cb8b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:39.601854 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e77a8de-1a40-466d-9266-30b55dc3cb8b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:39.602302 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e77a8de-1a40-466d-9266-30b55dc3cb8b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:39.603052 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e77a8de-1a40-466d-9266-30b55dc3cb8b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:39.603482 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e77a8de-1a40-466d-9266-30b55dc3cb8b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:39.736088 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6e77a8de-1a40-466d-9266-30b55dc3cb8b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:39.743506 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6e77a8de-1a40-466d-9266-30b55dc3cb8b tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1551 microversion: 2.1 time: 0.153550 May 25 17:19:39.744060 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 520/1068] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:39 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:40.501838 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [req-07535edb-7d3c-4b6d-b784-0a6480781b8f req-ccda5b91-2ef6-49a8-88d0-3ad95c1ecb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04921db8-8f39-49f2-b92b-0f01b6dcf48e", "name": "network-vif-deleted", "tag": "5c08472c-6b26-4979-9138-9b2053d5447f"}]} {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:19:40.512703 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-07535edb-7d3c-4b6d-b784-0a6480781b8f req-ccda5b91-2ef6-49a8-88d0-3ad95c1ecb2d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:40.513267 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [req-07535edb-7d3c-4b6d-b784-0a6480781b8f req-ccda5b91-2ef6-49a8-88d0-3ad95c1ecb2d service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:40.525107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.compute.server_external_events [req-07535edb-7d3c-4b6d-b784-0a6480781b8f req-ccda5b91-2ef6-49a8-88d0-3ad95c1ecb2d service nova] Creating event network-vif-deleted:5c08472c-6b26-4979-9138-9b2053d5447f for instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e on hv-cinder-84330 May 25 17:19:40.531526 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [req-07535edb-7d3c-4b6d-b784-0a6480781b8f req-ccda5b91-2ef6-49a8-88d0-3ad95c1ecb2d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032617 May 25 17:19:40.532111 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 549/1069] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:19:40.761741 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:40.762413 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:40.769483 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:40.769929 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:40.770696 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:40.771127 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:40.803672 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:40.804230 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:40.804801 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lazy-loading 'fault' on Instance uuid 04921db8-8f39-49f2-b92b-0f01b6dcf48e {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:19:40.854283 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03703b61e1d3442aaf8346abb5159725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f7502e12548c5820b9b176a98b349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:19:40.863398 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bd153d0c-3173-41cc-bea1-971320650c05 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 200 len: 1345 microversion: 2.1 time: 0.105459 May 25 17:19:40.864274 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 521/1070] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:40 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:19:41.881620 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4c0d1abb-a226-42cf-bd83-47e04aaf0301 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:41.882355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-4c0d1abb-a226-42cf-bd83-47e04aaf0301 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] [instance: 04921db8-8f39-49f2-b92b-0f01b6dcf48e] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:19:41.889067 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4c0d1abb-a226-42cf-bd83-47e04aaf0301 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:41.889528 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4c0d1abb-a226-42cf-bd83-47e04aaf0301 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:41.890537 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4c0d1abb-a226-42cf-bd83-47e04aaf0301 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:19:41.890890 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-4c0d1abb-a226-42cf-bd83-47e04aaf0301 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:19:41.903801 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-4c0d1abb-a226-42cf-bd83-47e04aaf0301 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] HTTP exception thrown: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e could not be found. May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4c0d1abb-a226-42cf-bd83-47e04aaf0301 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Request method failure captured: May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e HTTP/1.1 May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmShOIKhIyos9Yp34r3fA-VVuRPdD-RDGHCjWW9XMjSmfaXck9RVbOm52rt6fklQFC4fj55ifaFbUKS4vsH_Ahm7NNoD4ljJEzSM5vYoPSBJK4hGUCLtPfhpH60ObYaltVsxEX2Cl7U9MrbC8mBvy4XPmG01XYHrrBssQLpJBOaSSeA May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: 195f7502e12548c5820b9b176a98b349 May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-TestMinimumBasicScenario-2106354435 May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:19:41.906062 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_195f7502e12548c5820b9b176a98b349"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/195f7502e12548c5820b9b176a98b349"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/195f7502e12548c5820b9b176a98b349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/195f7502e12548c5820b9b176a98b349"}]}] May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-TestMinimumBasicScenario-2106354435 May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: 195f7502e12548c5820b9b176a98b349 May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2106354435 May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-TestMinimumBasicScenario-2106354435-project May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 03703b61e1d3442aaf8346abb5159725 May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-TestMinimumBasicScenario-2106354435-project May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e could not be found. May 25 17:19:41.907697 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': '04921db8-8f39-49f2-b92b-0f01b6dcf48e'} May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e could not be found. May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:19:41.908578 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e could not be found. May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e could not be found. May 25 17:19:41.910096 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:19:41.911720 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-4c0d1abb-a226-42cf-bd83-47e04aaf0301 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Returning 404 to user: Instance 04921db8-8f39-49f2-b92b-0f01b6dcf48e could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:19:41.911720 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-4c0d1abb-a226-42cf-bd83-47e04aaf0301 tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e" status: 404 len: 111 microversion: 2.1 time: 0.030059 May 25 17:19:41.911720 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 550/1071] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:19:41 2022] GET /compute/v2.1/servers/04921db8-8f39-49f2-b92b-0f01b6dcf48e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:19:41.917551 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4b1ed2ab-b8d5-495f-846b-46369b0b347a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] Calling method '.version_select at 0x7f3d4ee0cdc0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:19:41.939158 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4b1ed2ab-b8d5-495f-846b-46369b0b347a tempest-TestMinimumBasicScenario-2106354435 tempest-TestMinimumBasicScenario-2106354435-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-544398757" status: 202 len: 0 microversion: 2.1 time: 0.025460 May 25 17:19:41.939659 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 522/1072] 10.222.0.31 () {58 vars in 1268 bytes} [Wed May 25 17:19:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-544398757 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:21:06.227044 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:21:06.227979 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG dbcounter [-] [117695] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:21:06.232521 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=74 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:21:06.233044 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7310658d-4b82-44e7-9371-13f1c51fe53c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:06.233145 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7310658d-4b82-44e7-9371-13f1c51fe53c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:06.234227 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:21:06.239313 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-6513b3b3-f21a-4754-9bfa-114b87eb0150 req-a8dac4cc-4ab1-4a64-ab70-ae4394712ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a", "tag": "9c8e824c-81df-4ecf-bf7a-aa05917e0cd1"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:21:06.241562 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7310658d-4b82-44e7-9371-13f1c51fe53c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:06.242025 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7310658d-4b82-44e7-9371-13f1c51fe53c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:06.242856 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7310658d-4b82-44e7-9371-13f1c51fe53c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:06.243310 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7310658d-4b82-44e7-9371-13f1c51fe53c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:06.252024 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6513b3b3-f21a-4754-9bfa-114b87eb0150 req-a8dac4cc-4ab1-4a64-ab70-ae4394712ed8 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:06.253011 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6513b3b3-f21a-4754-9bfa-114b87eb0150 req-a8dac4cc-4ab1-4a64-ab70-ae4394712ed8 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:06.265988 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-6513b3b3-f21a-4754-9bfa-114b87eb0150 req-a8dac4cc-4ab1-4a64-ab70-ae4394712ed8 service nova] Creating event network-changed:9c8e824c-81df-4ecf-bf7a-aa05917e0cd1 for instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a on hv-cinder-84330 May 25 17:21:06.270577 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7310658d-4b82-44e7-9371-13f1c51fe53c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:21:06.273128 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-6513b3b3-f21a-4754-9bfa-114b87eb0150 req-a8dac4cc-4ab1-4a64-ab70-ae4394712ed8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042201 May 25 17:21:06.274122 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 523/1073] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:21:06.353908 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7310658d-4b82-44e7-9371-13f1c51fe53c tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "DELETE /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 204 len: 0 microversion: 2.1 time: 0.129215 May 25 17:21:06.354679 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 551/1074] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:21:06 2022] DELETE /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 17:21:06.364025 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-46a0e5f5-8d39-4efa-a8c2-259a13a4599e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:06.364804 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-46a0e5f5-8d39-4efa-a8c2-259a13a4599e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:06.372333 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-46a0e5f5-8d39-4efa-a8c2-259a13a4599e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:06.372818 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-46a0e5f5-8d39-4efa-a8c2-259a13a4599e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:06.373978 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-46a0e5f5-8d39-4efa-a8c2-259a13a4599e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:06.374118 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-46a0e5f5-8d39-4efa-a8c2-259a13a4599e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:06.514241 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-46a0e5f5-8d39-4efa-a8c2-259a13a4599e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:21:06.521771 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-46a0e5f5-8d39-4efa-a8c2-259a13a4599e tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1577 microversion: 2.1 time: 0.162135 May 25 17:21:06.523114 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 524/1075] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:21:06 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:21:07.538536 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7376e488-1e3c-4a12-be9a-425c77d08c43] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 25 17:21:07.542255 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-03ac6918-e7f2-4114-8fc0-42351b2362a2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:07.542966 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-03ac6918-e7f2-4114-8fc0-42351b2362a2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:07.548932 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-03ac6918-e7f2-4114-8fc0-42351b2362a2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:07.549413 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-03ac6918-e7f2-4114-8fc0-42351b2362a2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:07.550185 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-03ac6918-e7f2-4114-8fc0-42351b2362a2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:07.550625 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-03ac6918-e7f2-4114-8fc0-42351b2362a2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:07.741445 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-03ac6918-e7f2-4114-8fc0-42351b2362a2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:21:07.748967 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-03ac6918-e7f2-4114-8fc0-42351b2362a2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1577 microversion: 2.1 time: 0.212723 May 25 17:21:07.749525 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 552/1076] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:21:07 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:21:08.305319 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-25529351-c021-41f5-8de0-93295b4f4aa4 req-1126afe6-0886-4dd6-8a7f-69220012af11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a", "name": "network-vif-deleted", "tag": "9c8e824c-81df-4ecf-bf7a-aa05917e0cd1"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:21:08.315851 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-25529351-c021-41f5-8de0-93295b4f4aa4 req-1126afe6-0886-4dd6-8a7f-69220012af11 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:08.316291 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-25529351-c021-41f5-8de0-93295b4f4aa4 req-1126afe6-0886-4dd6-8a7f-69220012af11 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:08.328729 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-25529351-c021-41f5-8de0-93295b4f4aa4 req-1126afe6-0886-4dd6-8a7f-69220012af11 service nova] Creating event network-vif-deleted:9c8e824c-81df-4ecf-bf7a-aa05917e0cd1 for instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a on hv-cinder-84330 May 25 17:21:08.334364 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-25529351-c021-41f5-8de0-93295b4f4aa4 req-1126afe6-0886-4dd6-8a7f-69220012af11 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 May 25 17:21:08.335154 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 525/1077] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:21:08.767363 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:08.767967 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:08.776259 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:08.776734 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:08.777490 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:08.777923 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:08.783885 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO oslo.messaging._drivers.impl_rabbit [-] [7376e488-1e3c-4a12-be9a-425c77d08c43] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 41252. May 25 17:21:08.810516 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:08.810969 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:08.811416 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lazy-loading 'fault' on Instance uuid 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:21:08.852332 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:21:08.859777 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-5dbad87c-8b4f-4679-bc36-d8bc32a673a8 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 200 len: 1230 microversion: 2.1 time: 0.096318 May 25 17:21:08.860336 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 553/1078] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:21:08 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:21:09.878238 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3562d68c-16b1-473e-8d8f-612a6616d4af tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:09.878933 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3562d68c-16b1-473e-8d8f-612a6616d4af tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:09.886345 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3562d68c-16b1-473e-8d8f-612a6616d4af tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:09.886791 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3562d68c-16b1-473e-8d8f-612a6616d4af tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:09.887544 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3562d68c-16b1-473e-8d8f-612a6616d4af tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:09.887974 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3562d68c-16b1-473e-8d8f-612a6616d4af tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:09.901304 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-3562d68c-16b1-473e-8d8f-612a6616d4af tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] HTTP exception thrown: Instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a could not be found. May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3562d68c-16b1-473e-8d8f-612a6616d4af tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Request method failure captured: May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a HTTP/1.1 May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmPfn8BR2T9QdescIgB-5jTN7-JI3-TIaVot41mhBltSCgDK9EEeMaO-lcjl7cKxGGJngRCoww2Q5nDriZcYuq-Ewrm_UP7yxLvLM5Wpaoz5XaN9OiSVffrtGDK3yKMXoCDXOgBD0FSHIeqn7QUpDp2FaEUo_ur5Xy6l3irwHcQSyvs May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: df9bc8d103cf40e1b8d984f1947e7c5d May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-TestVolumeBootPattern-114242761 May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:21:09.902882 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/df9bc8d103cf40e1b8d984f1947e7c5d"}]}] May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-TestVolumeBootPattern-114242761 May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: df9bc8d103cf40e1b8d984f1947e7c5d May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-TestVolumeBootPattern-114242761 May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-TestVolumeBootPattern-114242761-project May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 47642301725e4023aba48b2a3a64d5b9 May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-TestVolumeBootPattern-114242761-project May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a could not be found. May 25 17:21:09.904510 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a'} May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a could not be found. May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:21:09.905530 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a could not be found. May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a could not be found. May 25 17:21:09.907203 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:09.908843 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3562d68c-16b1-473e-8d8f-612a6616d4af tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Returning 404 to user: Instance 45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:21:09.908843 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3562d68c-16b1-473e-8d8f-612a6616d4af tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a" status: 404 len: 111 microversion: 2.1 time: 0.030218 May 25 17:21:09.908843 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 526/1079] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:21:09 2022] GET /compute/v2.1/servers/45b22d77-c8c1-4ed3-a0c9-4ebb20e8589a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:21:12.954127 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-cde541b1-c71b-41e9-a6a5-a48eac04ed03 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:12.954608 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-cde541b1-c71b-41e9-a6a5-a48eac04ed03 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:12.961787 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cde541b1-c71b-41e9-a6a5-a48eac04ed03 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:12.962440 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cde541b1-c71b-41e9-a6a5-a48eac04ed03 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:12.963223 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cde541b1-c71b-41e9-a6a5-a48eac04ed03 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:12.963663 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-cde541b1-c71b-41e9-a6a5-a48eac04ed03 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:12.989310 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-cde541b1-c71b-41e9-a6a5-a48eac04ed03 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Going to try to terminate instance {{(pid=117695) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 17:21:13.074494 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-cde541b1-c71b-41e9-a6a5-a48eac04ed03 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "DELETE /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 204 len: 0 microversion: 2.1 time: 0.123962 May 25 17:21:13.075290 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 554/1080] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:21:12 2022] DELETE /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 17:21:13.086070 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f3879b73-1ee7-41b8-ad88-fc3112f91225 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:13.087047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f3879b73-1ee7-41b8-ad88-fc3112f91225 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:13.093319 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f3879b73-1ee7-41b8-ad88-fc3112f91225 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:13.093770 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f3879b73-1ee7-41b8-ad88-fc3112f91225 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:13.094608 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f3879b73-1ee7-41b8-ad88-fc3112f91225 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:13.095047 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f3879b73-1ee7-41b8-ad88-fc3112f91225 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:13.226155 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-ba9b4d13-2730-40df-845f-efa951ec8198 req-10a9a6f9-2ba5-4fbd-98e3-d98517ab018a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ac9494-0f69-4730-bfa8-16654e1eff8c", "tag": "2a0150b3-ed16-4d05-8467-4a200d9130b6"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:21:13.235223 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-ba9b4d13-2730-40df-845f-efa951ec8198 req-10a9a6f9-2ba5-4fbd-98e3-d98517ab018a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:13.235723 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-ba9b4d13-2730-40df-845f-efa951ec8198 req-10a9a6f9-2ba5-4fbd-98e3-d98517ab018a service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:13.245635 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f3879b73-1ee7-41b8-ad88-fc3112f91225 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:21:13.249294 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-ba9b4d13-2730-40df-845f-efa951ec8198 req-10a9a6f9-2ba5-4fbd-98e3-d98517ab018a service nova] Creating event network-changed:2a0150b3-ed16-4d05-8467-4a200d9130b6 for instance 51ac9494-0f69-4730-bfa8-16654e1eff8c on hv-cinder-84330 May 25 17:21:13.253343 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f3879b73-1ee7-41b8-ad88-fc3112f91225 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1576 microversion: 2.1 time: 0.172702 May 25 17:21:13.260721 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-ba9b4d13-2730-40df-845f-efa951ec8198 req-10a9a6f9-2ba5-4fbd-98e3-d98517ab018a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301486 May 25 17:21:13.261328 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 555/1081] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:21:13 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 17:21:13.261439 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 527/1082] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:21:13.665107 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:21:13.665330 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Wed May 25 17:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:21:14.274503 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-f3648a99-7695-4638-9262-dbb729369ceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:14.275549 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-f3648a99-7695-4638-9262-dbb729369ceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:14.283253 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f3648a99-7695-4638-9262-dbb729369ceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:14.283707 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f3648a99-7695-4638-9262-dbb729369ceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:14.285802 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f3648a99-7695-4638-9262-dbb729369ceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:14.286194 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-f3648a99-7695-4638-9262-dbb729369ceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:14.454123 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-f3648a99-7695-4638-9262-dbb729369ceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:21:14.462915 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-f3648a99-7695-4638-9262-dbb729369ceb tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1576 microversion: 2.1 time: 0.194755 May 25 17:21:14.463496 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 556/1083] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:21:14 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:21:15.272669 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-16b1c91f-4ebd-4bfa-903f-73f212ae0018 req-1e846ad1-b9f8-431b-8b10-661bbd6a6073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ac9494-0f69-4730-bfa8-16654e1eff8c", "name": "network-vif-deleted", "tag": "2a0150b3-ed16-4d05-8467-4a200d9130b6"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 17:21:15.282009 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-16b1c91f-4ebd-4bfa-903f-73f212ae0018 req-1e846ad1-b9f8-431b-8b10-661bbd6a6073 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:15.282458 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-16b1c91f-4ebd-4bfa-903f-73f212ae0018 req-1e846ad1-b9f8-431b-8b10-661bbd6a6073 service nova] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:15.294097 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-16b1c91f-4ebd-4bfa-903f-73f212ae0018 req-1e846ad1-b9f8-431b-8b10-661bbd6a6073 service nova] Creating event network-vif-deleted:2a0150b3-ed16-4d05-8467-4a200d9130b6 for instance 51ac9494-0f69-4730-bfa8-16654e1eff8c on hv-cinder-84330 May 25 17:21:15.299002 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-16b1c91f-4ebd-4bfa-903f-73f212ae0018 req-1e846ad1-b9f8-431b-8b10-661bbd6a6073 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031332 May 25 17:21:15.299612 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 528/1084] 10.222.0.31 () {64 vars in 1317 bytes} [Wed May 25 17:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 17:21:15.480734 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:15.481101 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:15.487703 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:15.488163 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:15.488971 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:15.489416 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:15.524990 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:15.525694 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:15.526583 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.objects.instance [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lazy-loading 'fault' on Instance uuid 51ac9494-0f69-4730-bfa8-16654e1eff8c {{(pid=117695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 17:21:15.573623 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.policy [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47642301725e4023aba48b2a3a64d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117695) authorize /opt/stack/nova/nova/policy.py:199}} May 25 17:21:15.582126 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-8ae0198c-17ee-4e0c-846d-d4042fe181c0 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 200 len: 1230 microversion: 2.1 time: 0.105765 May 25 17:21:15.582701 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 557/1085] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:21:15 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 17:21:16.600814 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0de8a600-09ff-4c22-8db2-8e44c2c79641 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:16.601514 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0de8a600-09ff-4c22-8db2-8e44c2c79641 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: 51ac9494-0f69-4730-bfa8-16654e1eff8c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:16.607786 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0de8a600-09ff-4c22-8db2-8e44c2c79641 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:16.608239 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0de8a600-09ff-4c22-8db2-8e44c2c79641 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:16.609024 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0de8a600-09ff-4c22-8db2-8e44c2c79641 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:16.609461 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0de8a600-09ff-4c22-8db2-8e44c2c79641 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:16.623060 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-0de8a600-09ff-4c22-8db2-8e44c2c79641 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] HTTP exception thrown: Instance 51ac9494-0f69-4730-bfa8-16654e1eff8c could not be found. May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0de8a600-09ff-4c22-8db2-8e44c2c79641 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Request method failure captured: May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c HTTP/1.1 May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmPfn8BR2T9QdescIgB-5jTN7-JI3-TIaVot41mhBltSCgDK9EEeMaO-lcjl7cKxGGJngRCoww2Q5nDriZcYuq-Ewrm_UP7yxLvLM5Wpaoz5XaN9OiSVffrtGDK3yKMXoCDXOgBD0FSHIeqn7QUpDp2FaEUo_ur5Xy6l3irwHcQSyvs May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: df9bc8d103cf40e1b8d984f1947e7c5d May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-TestVolumeBootPattern-114242761 May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:21:16.624652 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/df9bc8d103cf40e1b8d984f1947e7c5d"}]}] May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-TestVolumeBootPattern-114242761 May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: df9bc8d103cf40e1b8d984f1947e7c5d May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-TestVolumeBootPattern-114242761 May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-TestVolumeBootPattern-114242761-project May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 47642301725e4023aba48b2a3a64d5b9 May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-TestVolumeBootPattern-114242761-project May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance 51ac9494-0f69-4730-bfa8-16654e1eff8c could not be found. May 25 17:21:16.626251 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '51ac9494-0f69-4730-bfa8-16654e1eff8c'} May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51ac9494-0f69-4730-bfa8-16654e1eff8c could not be found. May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:21:16.627318 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51ac9494-0f69-4730-bfa8-16654e1eff8c could not be found. May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51ac9494-0f69-4730-bfa8-16654e1eff8c could not be found. May 25 17:21:16.628824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:16.630181 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0de8a600-09ff-4c22-8db2-8e44c2c79641 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Returning 404 to user: Instance 51ac9494-0f69-4730-bfa8-16654e1eff8c could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:21:16.630181 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0de8a600-09ff-4c22-8db2-8e44c2c79641 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c" status: 404 len: 111 microversion: 2.1 time: 0.030199 May 25 17:21:16.630181 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 529/1086] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:21:16 2022] GET /compute/v2.1/servers/51ac9494-0f69-4730-bfa8-16654e1eff8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:21:17.060916 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7ddf186f-eb64-4567-b0db-c1fb3e3f0d28 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:17.061451 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.compute.api [None req-7ddf186f-eb64-4567-b0db-c1fb3e3f0d28 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117695) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:17.068355 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7ddf186f-eb64-4567-b0db-c1fb3e3f0d28 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:17.068921 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7ddf186f-eb64-4567-b0db-c1fb3e3f0d28 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:17.069653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7ddf186f-eb64-4567-b0db-c1fb3e3f0d28 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:17.070093 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG oslo_concurrency.lockutils [None req-7ddf186f-eb64-4567-b0db-c1fb3e3f0d28 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:17.085639 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.wsgi [None req-7ddf186f-eb64-4567-b0db-c1fb3e3f0d28 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] HTTP exception thrown: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7ddf186f-eb64-4567-b0db-c1fb3e3f0d28 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Request method failure captured: May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: request: DELETE /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f HTTP/1.1 May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept: application/json May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Accept-Encoding: identity May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Connection: close May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Length: 0 May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Content-Type: application/json May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Host: 10.222.0.31 May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Openstack-System-Scope: None May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: User-Agent: python-urllib3/1.26.9 May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Auth-Token: gAAAAABijmPfn8BR2T9QdescIgB-5jTN7-JI3-TIaVot41mhBltSCgDK9EEeMaO-lcjl7cKxGGJngRCoww2Q5nDriZcYuq-Ewrm_UP7yxLvLM5Wpaoz5XaN9OiSVffrtGDK3yKMXoCDXOgBD0FSHIeqn7QUpDp2FaEUo_ur5Xy6l3irwHcQSyvs May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Id: None May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Domain-Name: None May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Identity-Status: Confirmed May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Is-Admin-Project: True May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Id: default May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Domain-Name: Default May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Id: df9bc8d103cf40e1b8d984f1947e7c5d May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Project-Name: tempest-TestVolumeBootPattern-114242761 May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Role: reader,member May 25 17:21:17.087288 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Roles: reader,member May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/df9bc8d103cf40e1b8d984f1947e7c5d"}]}] May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant: tempest-TestVolumeBootPattern-114242761 May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Id: df9bc8d103cf40e1b8d984f1947e7c5d May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-Tenant-Name: tempest-TestVolumeBootPattern-114242761 May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User: tempest-TestVolumeBootPattern-114242761-project May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Id: default May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Domain-Name: Default May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Id: 47642301725e4023aba48b2a3a64d5b9 May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: X-User-Name: tempest-TestVolumeBootPattern-114242761-project May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: method: > May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: exception: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:21:17.088653 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: action_args: {'id': 'd48a0fde-a6e2-447e-b977-2a8d2ecca65f'} May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:21:17.089542 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:21:17.091124 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: ERROR nova.api.openstack.wsgi May 25 17:21:17.092710 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-7ddf186f-eb64-4567-b0db-c1fb3e3f0d28 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Returning 404 to user: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. {{(pid=117695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:21:17.092710 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-7ddf186f-eb64-4567-b0db-c1fb3e3f0d28 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 404 len: 111 microversion: 2.1 time: 0.031610 May 25 17:21:17.092710 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 558/1087] 10.222.0.31 () {58 vars in 1238 bytes} [Wed May 25 17:21:17 2022] DELETE /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:21:17.097164 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c34e770a-2641-47a0-97cc-d44d8eeba83f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:17.097780 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c34e770a-2641-47a0-97cc-d44d8eeba83f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] [instance: d48a0fde-a6e2-447e-b977-2a8d2ecca65f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 17:21:17.104567 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c34e770a-2641-47a0-97cc-d44d8eeba83f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:17.105054 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c34e770a-2641-47a0-97cc-d44d8eeba83f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:17.105824 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c34e770a-2641-47a0-97cc-d44d8eeba83f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 17:21:17.106292 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c34e770a-2641-47a0-97cc-d44d8eeba83f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Lock "a24b6412-6df0-4cb6-9852-3a2a26f5f191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 17:21:17.120047 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-c34e770a-2641-47a0-97cc-d44d8eeba83f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] HTTP exception thrown: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c34e770a-2641-47a0-97cc-d44d8eeba83f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Request method failure captured: May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f HTTP/1.1 May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Connection: close May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.31 May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABijmPfn8BR2T9QdescIgB-5jTN7-JI3-TIaVot41mhBltSCgDK9EEeMaO-lcjl7cKxGGJngRCoww2Q5nDriZcYuq-Ewrm_UP7yxLvLM5Wpaoz5XaN9OiSVffrtGDK3yKMXoCDXOgBD0FSHIeqn7QUpDp2FaEUo_ur5Xy6l3irwHcQSyvs May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Id: df9bc8d103cf40e1b8d984f1947e7c5d May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-TestVolumeBootPattern-114242761 May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Role: reader,member May 25 17:21:17.121572 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Roles: reader,member May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.31:8080", "publicURL": "http://10.222.0.31:8080/v1/AUTH_df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2/df9bc8d103cf40e1b8d984f1947e7c5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.31/volume/v3/df9bc8d103cf40e1b8d984f1947e7c5d"}]}] May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-TestVolumeBootPattern-114242761 May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: df9bc8d103cf40e1b8d984f1947e7c5d May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-TestVolumeBootPattern-114242761 May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User: tempest-TestVolumeBootPattern-114242761-project May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Id: 47642301725e4023aba48b2a3a64d5b9 May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-TestVolumeBootPattern-114242761-project May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: method: > May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: exception: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:21:17.123275 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'd48a0fde-a6e2-447e-b977-2a8d2ecca65f'} May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 17:21:17.124077 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. May 25 17:21:17.125378 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 25 17:21:17.126502 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c34e770a-2641-47a0-97cc-d44d8eeba83f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Returning 404 to user: Instance d48a0fde-a6e2-447e-b977-2a8d2ecca65f could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 17:21:17.126502 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c34e770a-2641-47a0-97cc-d44d8eeba83f tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f" status: 404 len: 111 microversion: 2.1 time: 0.029574 May 25 17:21:17.126502 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 530/1088] 10.222.0.31 () {58 vars in 1235 bytes} [Wed May 25 17:21:17 2022] GET /compute/v2.1/servers/d48a0fde-a6e2-447e-b977-2a8d2ecca65f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 17:21:18.413510 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: DEBUG nova.api.openstack.wsgi [None req-033b6fea-0e1a-4967-a225-e5b5db1696b2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] Calling method '.version_select at 0x7f3d4e2b6820>' {{(pid=117695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 17:21:18.432586 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO nova.api.openstack.requestlog [None req-033b6fea-0e1a-4967-a225-e5b5db1696b2 tempest-TestVolumeBootPattern-114242761 tempest-TestVolumeBootPattern-114242761-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-500528931" status: 202 len: 0 microversion: 2.1 time: 0.023170 May 25 17:21:18.433574 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: [pid: 117695|app: 0|req: 559/1089] 10.222.0.31 () {58 vars in 1259 bytes} [Wed May 25 17:21:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-500528931 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 17:22:32.673117 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:22:32.673746 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Wed May 25 17:22:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:22:37.444066 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:22:37.444729 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Wed May 25 17:22:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:24:33.673548 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:24:33.674173 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Wed May 25 17:24:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:24:34.483561 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:24:34.483771 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Wed May 25 17:24:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:25:52.682880 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:25:52.683330 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Wed May 25 17:25:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:25:57.452657 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:25:57.453347 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Wed May 25 17:25:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:26:15.004137 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:26:15.004751 dv-cinder-843309-1-iscsi devstack@n-api.service[117695]: Wed May 25 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 17:26:27.325234 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 17:26:27.325948 dv-cinder-843309-1-iscsi devstack@n-api.service[117696]: Wed May 25 17:26:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!